-- Logs begin at Fri 2022-07-22 10:32:21 UTC, end at Fri 2022-07-22 11:34:00 UTC. -- Jul 22 11:05:14.298615 dv-cinder-848900-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 22 11:05:14.307336 dv-cinder-848900-4-iscsi devstack@n-api.service[103397]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 22 11:05:14.309314 dv-cinder-848900-4-iscsi devstack@n-api.service[103397]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jul 22 11:05:14 2022] *** Jul 22 11:05:14.309314 dv-cinder-848900-4-iscsi devstack@n-api.service[103397]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 22 11:05:14.309314 dv-cinder-848900-4-iscsi devstack@n-api.service[103397]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 22 11:05:14.309314 dv-cinder-848900-4-iscsi devstack@n-api.service[103397]: nodename: dv-cinder-848900-4-iscsi Jul 22 11:05:14.309314 dv-cinder-848900-4-iscsi devstack@n-api.service[103397]: machine: x86_64 Jul 22 11:05:14.309314 dv-cinder-848900-4-iscsi devstack@n-api.service[103397]: clock source: unix Jul 22 11:05:14.309314 dv-cinder-848900-4-iscsi devstack@n-api.service[103397]: pcre jit disabled Jul 22 11:05:14.309314 dv-cinder-848900-4-iscsi devstack@n-api.service[103397]: detected number of CPU cores: 4 Jul 22 11:05:14.309314 dv-cinder-848900-4-iscsi devstack@n-api.service[103397]: current working directory: / Jul 22 11:05:14.309314 dv-cinder-848900-4-iscsi devstack@n-api.service[103397]: detected binary path: /usr/bin/uwsgi-core Jul 22 11:05:14.310014 dv-cinder-848900-4-iscsi devstack@n-api.service[103397]: your processes number limit is 47680 Jul 22 11:05:14.310014 dv-cinder-848900-4-iscsi devstack@n-api.service[103397]: your memory page size is 4096 bytes Jul 22 11:05:14.310014 dv-cinder-848900-4-iscsi devstack@n-api.service[103397]: detected max file descriptor number: 2048 Jul 22 11:05:14.310014 dv-cinder-848900-4-iscsi devstack@n-api.service[103397]: lock engine: pthread robust mutexes Jul 22 11:05:14.310014 dv-cinder-848900-4-iscsi devstack@n-api.service[103397]: thunder lock: enabled Jul 22 11:05:14.310014 dv-cinder-848900-4-iscsi devstack@n-api.service[103397]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 22 11:05:14.310014 dv-cinder-848900-4-iscsi devstack@n-api.service[103397]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 22 11:05:14.354382 dv-cinder-848900-4-iscsi devstack@n-api.service[103397]: Python main interpreter initialized at 0x55c628a529c0 Jul 22 11:05:14.354382 dv-cinder-848900-4-iscsi devstack@n-api.service[103397]: python threads support enabled Jul 22 11:05:14.354382 dv-cinder-848900-4-iscsi devstack@n-api.service[103397]: your server socket listen backlog is limited to 100 connections Jul 22 11:05:14.354382 dv-cinder-848900-4-iscsi devstack@n-api.service[103397]: your mercy for graceful operations on workers is 90 seconds Jul 22 11:05:14.354710 dv-cinder-848900-4-iscsi devstack@n-api.service[103397]: mapped 403077 bytes (393 KB) for 2 cores Jul 22 11:05:14.354840 dv-cinder-848900-4-iscsi devstack@n-api.service[103397]: *** Operational MODE: preforking *** Jul 22 11:05:14.355058 dv-cinder-848900-4-iscsi devstack@n-api.service[103397]: *** uWSGI is running in multiple interpreter mode *** Jul 22 11:05:14.355058 dv-cinder-848900-4-iscsi devstack@n-api.service[103397]: spawned uWSGI master process (pid: 103397) Jul 22 11:05:14.355229 dv-cinder-848900-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 22 11:05:14.357821 dv-cinder-848900-4-iscsi devstack@n-api.service[103397]: spawned uWSGI worker 1 (pid: 103398, cores: 1) Jul 22 11:05:14.357821 dv-cinder-848900-4-iscsi devstack@n-api.service[103397]: spawned uWSGI worker 2 (pid: 103399, cores: 1) Jul 22 11:05:14.357821 dv-cinder-848900-4-iscsi devstack@n-api.service[103397]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 22 11:05:15.021376 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 22 11:05:15.022328 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 22 11:05:16.152372 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 22 11:05:16.152372 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: from cryptography.utils import int_from_bytes Jul 22 11:05:16.153079 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 22 11:05:16.153079 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: from cryptography.utils import int_from_bytes Jul 22 11:05:16.153460 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 22 11:05:16.153460 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: from cryptography.utils import int_from_bytes Jul 22 11:05:16.153573 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 22 11:05:16.153573 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: from cryptography.utils import int_from_bytes Jul 22 11:05:18.679961 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 22 11:05:18.680600 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 22 11:05:18.680699 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 22 11:05:18.680699 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 22 11:05:18.681129 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 22 11:05:18.681129 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 22 11:05:18.681282 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 22 11:05:18.681360 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 22 11:05:18.681485 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 22 11:05:18.681676 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.681778 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 22 11:05:18.681999 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.682093 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.682318 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.682411 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.682635 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.682730 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.682965 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.683060 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.683301 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.683407 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.683623 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.683708 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.683940 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.684026 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.684266 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.684385 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.684519 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.684642 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.684827 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.684951 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.685137 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.685269 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-848900-4-iscsi {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.685457 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.685586 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-848900-4-iscsi {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.685761 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.685885 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.686065 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.686189 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.686919 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.687057 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.687241 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.687393 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.687565 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.687698 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.687887 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.688012 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.688193 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.688409 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.688692 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.688853 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.689001 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.689162 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.689305 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.689475 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.689616 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.689812 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.689937 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.690110 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.690242 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.690457 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.690593 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.690722 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.690857 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.691027 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.691161 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.691373 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.691501 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.691683 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.691809 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.692078 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-848900-4-iscsi {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.692211 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-848900-4-iscsi {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.692395 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.692529 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.692708 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.692839 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.693022 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.693139 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.693434 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.693566 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.693744 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.693868 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.694050 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.694181 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.694369 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.694499 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.694693 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.694819 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.695002 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.695134 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.695347 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.695473 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.695670 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.695802 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.695988 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.696113 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.696307 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.696429 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.696609 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.696732 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.696914 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.697044 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.697221 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.697343 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.697536 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.697661 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.697842 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.697975 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.698146 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.698269 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.698389 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.698516 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.698688 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.698845 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.699007 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.699130 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.699353 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.699493 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.699676 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.699804 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.699929 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.700052 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.700182 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.700307 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.700471 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.700676 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.700802 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.700933 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.701066 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.701189 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.701378 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.701503 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.701682 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.701817 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.702016 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.702142 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.702320 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.702450 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.702625 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.702756 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.702930 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.703060 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.703236 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.703376 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.703580 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.703718 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.703894 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.704020 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.704215 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.704348 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.704523 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.704649 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.704842 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.704967 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.705242 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.705367 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.705569 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.705693 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.705814 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.705934 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.706114 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.706238 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.706430 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.706565 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.706736 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.706860 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.707053 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.707181 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.707397 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.707531 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.707709 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.707833 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.708016 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.708140 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.708321 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.708446 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.708639 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.708761 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.708971 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.709093 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.709274 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.709437 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.709564 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.709691 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.709813 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.709942 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.710106 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.710235 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.710429 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.710560 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.710731 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.710873 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.711033 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.711121 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.711361 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.711450 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.711663 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.711760 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.711969 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.712066 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.712275 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.712368 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.712579 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.712672 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.712888 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.713047 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.713197 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.713334 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.713490 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.713628 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.713765 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.713910 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.714044 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.714175 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.714352 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.714479 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.714668 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.714792 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.714987 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.715110 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.715310 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.715446 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.715619 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.715755 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.715920 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.716053 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.716223 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.716356 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.716541 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.716678 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.716843 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.716967 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.717145 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.717269 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.717479 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.717602 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.717790 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.717915 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.718094 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.718219 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.718408 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.718534 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.718714 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.718845 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.719018 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.719144 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.719357 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.719485 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.719658 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.719783 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.719967 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.720100 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.720282 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.720407 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.720588 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.720720 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.720896 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.721018 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.721195 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.721290 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.721497 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.721605 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.721798 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.721898 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.722099 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.722192 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.722396 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.722502 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.722698 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.722797 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.722993 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.723085 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.723330 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.723440 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.723649 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.723733 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.723955 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.724039 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.724259 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.724362 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.724562 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.724647 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.724882 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.725018 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:05:18.725214 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.725339 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.725542 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.725672 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.725881 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.726004 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.726195 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.726328 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.726524 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.726656 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.726851 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.726987 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.727169 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.727323 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.727505 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.727628 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.727818 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.727952 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.728143 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.728274 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.728454 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.728585 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.728765 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.728898 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.729075 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.729198 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.729391 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.729515 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.729706 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.729857 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.730032 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.730157 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.730348 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.730472 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.730663 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.730795 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.731035 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.731170 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.731327 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.731443 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.731613 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.731738 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.731942 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.732068 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.732261 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.732485 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.732620 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.732809 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.732943 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.733684 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.733890 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.734047 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.734184 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.734380 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.734504 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.734703 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.734832 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.735016 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.735149 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.735350 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.735478 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.735666 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.735792 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.735990 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.736397 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.736589 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.736714 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.736901 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.737024 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.737219 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.737352 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.737528 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.737661 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.737838 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.737962 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.738146 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.738277 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.738475 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.738598 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.738754 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.738889 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.739061 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.739193 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.739420 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.739561 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.739738 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.739865 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.740050 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.740175 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.740365 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.740490 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.740676 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.740799 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.740986 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.741123 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.741315 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.741439 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.741586 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.741710 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.741887 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.742022 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.742189 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.742313 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.742492 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.742628 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.742833 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.742962 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.743084 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.743204 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.743428 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.743565 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.743746 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.743869 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.744052 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.744178 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.744372 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.744504 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.744675 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.744799 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.744982 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.745107 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.745291 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.745424 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.745595 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.745718 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.745900 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.746023 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.746207 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.746331 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.746512 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.746637 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.746815 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.746945 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.747134 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.747295 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.747466 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.747594 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.747768 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.747899 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.748080 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.748205 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.748385 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.748510 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.748688 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.748874 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.749558 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.749731 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.749878 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.750067 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.750197 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.750374 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.750507 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.750693 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.750818 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.751009 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.751134 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.751366 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.751484 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.751683 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.751773 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.751996 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.752092 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.752331 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.752417 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.752654 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.752745 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.752959 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.753050 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.753280 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.753362 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.753584 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.753668 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.753897 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.753990 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.754201 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.754284 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.754503 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.754586 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.754813 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.754991 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.755110 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.755209 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.755427 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.755523 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.755730 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.755828 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.756032 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.756124 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.756339 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.756496 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.756642 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.756897 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.757047 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.757192 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.757339 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.757483 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.757640 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.757788 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.757937 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.758082 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.758241 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.758412 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.758596 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.758747 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.758879 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.759006 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.759139 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.759313 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.759469 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.759601 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.759730 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.759861 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.760034 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.760347 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.760474 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.760608 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.760739 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.760879 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.761021 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.761166 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.761304 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.761564 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.761717 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.761863 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.762000 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.762146 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.762292 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.762429 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.762565 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.762708 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.762855 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.763011 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.763159 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.763325 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.763476 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.763625 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.763762 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.763908 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.764047 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.764287 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.764458 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.764639 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.764896 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.765050 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.765255 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.765495 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.765640 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.765953 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.766134 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.766310 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.766628 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.766771 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.766957 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.767318 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.767477 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.767625 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.767934 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.768084 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.768250 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.768431 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.768587 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.768748 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.768890 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.769060 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.769214 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.769380 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.769533 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.769705 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.769860 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.770019 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.770341 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.770492 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.770661 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.770847 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.771181 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.771357 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.771506 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.771831 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.771977 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.772143 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.772443 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.772605 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.772781 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.773031 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.773182 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.773417 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.773635 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.773778 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.774075 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.774235 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.774488 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.774656 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.774800 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.775117 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.775302 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.775474 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.775794 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.775936 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.776114 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.776398 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.776553 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.776732 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.776977 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.777120 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.777364 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.777579 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.777742 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.778000 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.778141 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.778414 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.778556 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.778822 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.778997 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.779252 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.779604 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.779757 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.779922 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.780739 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.780892 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.781041 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.781329 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.781479 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.781768 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.781896 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.782154 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.782277 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.782616 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.782774 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.782942 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.783298 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.783434 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.783638 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.783954 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.784038 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.784268 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.784525 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.784610 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.784899 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.784982 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.785210 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.785306 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.785519 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.785602 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.785829 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.785927 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.786137 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.786297 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.786475 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.786617 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.786783 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.786926 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.787071 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.787216 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.787424 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.787577 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.787743 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.787884 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.788057 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.788222 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.788361 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.788496 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.788666 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.788809 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.788987 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.789131 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.789300 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.789441 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.789616 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.789757 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.789926 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.790077 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.790227 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.790370 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.790534 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.790676 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.790893 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.791035 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.791171 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.791360 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.791502 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.791639 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.791786 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.792009 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.792164 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.792302 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.792438 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.792615 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.792818 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.792962 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.793098 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.793235 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.793371 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.793522 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.793816 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.793962 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.794149 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.794319 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.794457 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.794603 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.794772 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.794915 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.795089 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.795239 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.795434 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.795616 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.796335 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.796480 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.796690 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.796859 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.797005 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.797142 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.797302 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.797452 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.797590 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.797726 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.797870 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.798007 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.798181 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.798332 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.798470 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.798607 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.798780 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.798932 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.799077 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.799226 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.799420 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.799608 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.799750 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.799887 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.800035 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.800180 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.800317 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.800452 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.800588 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.800735 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.800879 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.801024 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.801190 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.801333 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.801503 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.801645 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.801836 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.802005 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.802258 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.802446 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.802632 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.802830 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.803050 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.803300 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.803490 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.803640 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.803779 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.803923 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.804090 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.804236 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.804373 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.804519 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.804657 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.804802 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.804951 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.805137 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.805339 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.805535 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.805719 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.805934 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.806123 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.806261 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.806397 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.806532 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.806667 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.806812 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.806950 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.807106 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.807243 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.807427 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.807575 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.807749 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.807935 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.808134 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.808330 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.808524 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.808727 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.808869 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.809005 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.809141 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.809288 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.809425 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.809569 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.809706 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.809853 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.809997 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.810134 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.810289 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.810481 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.810676 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.810873 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.811060 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.811323 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.811500 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.811640 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.811776 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.811912 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.812047 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.812184 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.812423 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.812574 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.812719 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.812857 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.813000 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.813137 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.813293 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.813431 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.813567 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.813702 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.813837 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.813973 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.814117 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.814254 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.814399 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.814536 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.814672 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.814816 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.814953 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.815099 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.815235 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.815396 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.815533 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.815755 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.815895 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.816031 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.816166 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.816302 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.816436 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.816581 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.816720 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.816855 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.817002 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.817138 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.817281 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.817432 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.817569 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.817706 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.817848 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.817985 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.818131 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.818269 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.818411 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.818550 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.818693 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.818840 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.818984 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.819121 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.819309 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.819464 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.819602 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.819739 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.819889 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.820026 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.820181 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.820319 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.820454 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.820591 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.820757 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.820895 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.821031 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.821173 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.821313 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.821458 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.821594 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.821732 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.821875 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.822012 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.822155 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.822300 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.822530 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.822675 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.822812 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.822947 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.823082 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.823231 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.823392 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.823529 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.823664 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.823812 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.823957 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.824103 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.824240 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.824386 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.824521 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.824657 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.824802 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.824939 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.825083 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.825220 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.825363 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.825499 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.825647 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.825786 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.825921 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.826056 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.826203 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.826339 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.826483 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.826621 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.826764 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.826932 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.827069 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.827211 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.827416 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.827556 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.827691 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.827827 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.827972 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.828118 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.828267 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.828404 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.828540 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.828685 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.828829 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.828976 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.829113 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.829248 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.829382 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.829517 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.829659 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.829809 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.829954 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.830091 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.830226 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.830361 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.830495 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.830638 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.830782 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.830919 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.831062 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.831211 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.831364 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.831471 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.831564 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.831643 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.831728 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.831806 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.831891 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.831970 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.832163 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.832250 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.832471 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.832556 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.832781 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.832875 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.833090 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.833232 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.833394 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.833481 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.833720 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.833805 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.834032 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.834118 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.834336 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.834419 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.834644 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.834735 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.834948 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.835031 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.835274 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.835407 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.835581 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.835720 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.836017 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.836101 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.836321 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.836413 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.836630 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.836740 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.836933 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.837027 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.837238 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.837333 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.837548 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.837633 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.837853 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.837934 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.838165 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.838263 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.838473 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.838557 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.838861 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.838944 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.839176 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.839280 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.839510 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.839687 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.839842 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.839986 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.840138 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.840289 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.840433 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.840575 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.840716 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.840868 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.841027 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.841170 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.841322 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.841471 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.841623 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.841764 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.841914 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.842058 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.842199 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.842341 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.843097 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.843379 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.843548 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.843694 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.843836 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.843989 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.844132 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.844286 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.844431 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.844574 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.844717 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.844858 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.845040 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.845200 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.845367 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.845529 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.845743 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.845915 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.846059 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.846211 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.846355 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.846519 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.846672 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.846848 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.847010 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.847160 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.847327 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.847493 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.847647 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.847791 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.847945 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.848095 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.848248 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.848392 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.848541 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.848686 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.848829 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.848981 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.849134 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.849278 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.849420 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.849562 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.849714 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.849868 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.850021 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.850165 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.850387 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.850596 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.850742 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.850884 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.851037 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.851179 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.851360 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.851515 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.851661 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.851822 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.851975 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.852127 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.852271 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.852413 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.852556 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.852707 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.852851 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.852993 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.853224 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.853375 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.853518 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.853734 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.853892 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.854035 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.854179 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.854321 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.854471 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.854623 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.854774 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.854917 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.855059 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.855210 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.855390 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.855563 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.855715 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.855869 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.856013 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.856155 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.856309 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.856496 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.856645 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.856787 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.856937 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.857087 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.857260 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.857414 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.857558 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.857700 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.857854 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.858003 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.858707 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.858899 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.859048 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.859190 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.859381 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.859541 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.859686 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.859829 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.859971 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.860121 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.860277 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.860430 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.860582 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.860733 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.860876 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.861018 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.861427 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.861588 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.861732 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.861875 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.862024 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.862167 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.862319 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.862474 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.862617 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.862759 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.862902 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.863043 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.863215 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.863366 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.863473 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.863555 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.863632 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.863789 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.863887 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.864101 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.864188 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.864403 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.864495 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.864708 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.864802 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.865012 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.865098 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.865320 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.865405 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.865624 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.865718 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.865926 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.866027 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.866228 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.866320 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.866541 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.866626 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.866843 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.866927 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.867149 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.867355 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.867519 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.867665 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.867809 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.867951 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.868112 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.868263 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.868419 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.868569 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.868713 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.868857 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.869000 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.869142 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.869296 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.869441 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.869591 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.869739 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.869912 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.870081 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.870226 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.870369 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.870536 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.870687 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.870853 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.871014 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.871166 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.871329 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.871477 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.871618 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.871794 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.871956 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.872121 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.872263 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.872405 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.872547 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.872688 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.872839 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.873005 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.873156 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.873297 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.873458 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.873682 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.873866 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.874011 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.874173 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.874318 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.874460 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.874754 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.874913 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.875057 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.875199 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.875372 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.875517 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.875671 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.875816 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.875967 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.876121 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.876273 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.876426 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.876570 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.876712 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.876862 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.877006 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.877186 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.877346 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.877491 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.877641 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.877819 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.877980 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.878155 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.878315 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.878459 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.878602 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.878778 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.878935 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.879088 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.879233 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.879420 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.879564 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.879768 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.879933 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.880096 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.880247 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.880392 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.880535 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.880677 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.880839 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.880987 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.881129 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.881271 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.881413 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.881562 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.881730 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.881875 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.882017 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.882166 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.882315 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.882460 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.882685 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.882839 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.882990 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.883133 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.883297 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.883459 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.883621 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.883853 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.884012 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.884158 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.884300 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.884451 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.884597 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.884740 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.884881 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.885023 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.885166 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.885317 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.885480 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.885633 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.885783 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.885966 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.886124 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.886269 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.886417 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.886582 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.886733 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.886944 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.887100 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.887283 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.887439 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.887592 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.887736 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.887916 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.888077 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.888244 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.888394 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.888536 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.888677 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.888845 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.889003 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.889154 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.889304 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.889478 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.889632 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.889785 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.889936 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.890084 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.890227 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.890369 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.890519 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.890676 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.890879 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.891030 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.891203 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.891379 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.891535 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.891819 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.891980 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.892132 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.892274 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.892438 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.892588 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.892790 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.892972 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.893123 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.893324 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.893474 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.893626 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.893782 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.894011 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.894163 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.894313 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.894465 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.894617 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.894761 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.894904 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.895047 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.895189 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.895365 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.895495 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.895585 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.895803 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.895889 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.896122 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.896209 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.896431 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.896516 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.896735 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.896818 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.897038 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.897132 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.897418 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.897514 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.897649 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.897731 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.897953 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.898046 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.898256 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.898345 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.898558 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.898640 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.898866 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.898955 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.899173 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.899283 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.899502 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.899586 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.899805 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.899898 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.900111 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.900208 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.900411 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.900493 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.900714 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.900797 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.901016 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.901105 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.901321 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.901403 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.901629 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.901713 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.901932 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.902023 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.902240 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.902329 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.902543 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.902634 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.902854 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.902938 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.903158 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.903241 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.903502 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.903588 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.903820 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.903903 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.904134 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.904237 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.904447 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.904531 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.904752 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.904843 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.905579 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.905677 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.905889 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.905973 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.906229 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.906312 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.906666 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.906761 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.906989 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.907072 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.907361 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.907462 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.907687 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.907801 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.908054 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.908214 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.908364 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.908549 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.908673 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.908870 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.908981 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.909208 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.909301 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.909549 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.909641 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.909858 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.909948 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.910169 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.910342 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.910510 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.910672 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.910820 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.910964 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.911107 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.911250 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.911451 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.911597 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.911740 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.911891 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.912035 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.912177 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.912407 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.912554 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.912697 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.912841 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.912984 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.913126 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.913278 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.913423 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.913566 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.913717 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.913861 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.914013 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.914157 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.914310 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.914454 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.914597 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.914739 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.914891 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.915035 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.915179 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.915351 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.915497 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.915640 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.915795 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.915940 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.916094 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.916238 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.916387 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.916531 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.916688 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.916832 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.916977 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.917120 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.917270 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.917440 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.917684 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.917835 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.917977 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.918132 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.918275 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.918427 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.918574 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.918726 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.918871 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.919014 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.919158 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.919335 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.919493 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.919638 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.919787 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.919946 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.920099 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.920252 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.920397 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.920540 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.921235 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.921417 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.921580 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.921759 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.921909 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.922088 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.922238 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.922396 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.922550 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.922695 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.922837 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.923001 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.923158 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.923342 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.923493 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.923644 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.923788 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.923932 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.924074 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.924226 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.924440 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.924595 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.924737 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.924881 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.925022 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.925173 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.925327 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.925480 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.925631 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.925783 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.925936 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.926080 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.926223 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.926384 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.926530 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.926673 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.926825 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.926970 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.927113 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.927283 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.927434 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.927579 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.927822 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.927974 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.928118 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.928272 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.928424 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.928577 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.928733 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.928884 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.929034 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.929178 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.929328 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.929480 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.929633 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.929776 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.929930 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.930074 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.930235 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.930389 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.930534 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.930678 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.930821 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.930963 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.931104 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.931282 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.931435 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.931577 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.931721 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.931864 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.932017 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.932180 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.932333 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.932490 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.932634 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.932785 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.932937 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.933082 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.933224 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.933366 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.933509 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.933651 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.933811 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.933957 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.934110 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.934254 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.934396 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.934539 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.934693 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.934838 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.934981 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.935131 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.935330 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.935483 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.935639 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.935791 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.935953 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.936098 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.936265 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.936421 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.936566 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.936709 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.936858 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.937003 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.937145 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.937297 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.937442 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.937592 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.937743 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.937998 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.938151 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.938304 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.938448 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.938591 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.938747 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.938892 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.939047 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.939193 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.939362 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.939516 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.939661 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.939815 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.939978 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.940124 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.940267 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.940422 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.940567 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.940710 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.940929 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.941076 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.941226 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.941370 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.941512 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.941678 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.941823 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.941966 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.942108 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.942251 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.942394 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.942545 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.942688 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.942831 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.942974 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.943157 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.943338 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.943498 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.943654 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.943798 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.943947 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.944092 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.944244 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.944388 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.944531 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.944674 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.944816 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.944958 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.945110 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.945254 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.945408 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.945558 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 22 11:05:18.945702 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.945845 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.946127 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.946439 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.946745 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:05:18.946989 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 22 11:05:19.007144 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: INFO dbcounter [None req-89aba908-48c2-4c67-a2c9-4a589c828cf1 None None] Registered counter for database nova_api Jul 22 11:05:19.009259 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: INFO dbcounter [None req-7b62a488-8d5c-4639-a258-8e44135fe589 None None] Registered counter for database nova_api Jul 22 11:05:19.125946 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG oslo_db.sqlalchemy.engines [None req-89aba908-48c2-4c67-a2c9-4a589c828cf1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103399) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 22 11:05:19.127655 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG oslo_db.sqlalchemy.engines [None req-7b62a488-8d5c-4639-a258-8e44135fe589 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103398) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 22 11:05:19.132753 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG dbcounter [-] [103399] Writer thread running {{(pid=103399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 22 11:05:19.134207 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG dbcounter [-] [103398] Writer thread running {{(pid=103398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 22 11:05:19.189549 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.context [None req-89aba908-48c2-4c67-a2c9-4a589c828cf1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5a7515c3-306c-4208-a5ca-3c2d18d91397(cell1) {{(pid=103399) load_cells /opt/stack/nova/nova/context.py:464}} Jul 22 11:05:19.191315 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.context [None req-7b62a488-8d5c-4639-a258-8e44135fe589 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5a7515c3-306c-4208-a5ca-3c2d18d91397(cell1) {{(pid=103398) load_cells /opt/stack/nova/nova/context.py:464}} Jul 22 11:05:19.193562 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG oslo_concurrency.lockutils [None req-89aba908-48c2-4c67-a2c9-4a589c828cf1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:05:19.195130 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG oslo_concurrency.lockutils [None req-89aba908-48c2-4c67-a2c9-4a589c828cf1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:05:19.195237 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG oslo_concurrency.lockutils [None req-7b62a488-8d5c-4639-a258-8e44135fe589 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:05:19.195933 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG oslo_concurrency.lockutils [None req-89aba908-48c2-4c67-a2c9-4a589c828cf1 None None] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:05:19.196795 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG oslo_concurrency.lockutils [None req-7b62a488-8d5c-4639-a258-8e44135fe589 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:05:19.197585 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG oslo_concurrency.lockutils [None req-7b62a488-8d5c-4639-a258-8e44135fe589 None None] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:05:19.198016 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG oslo_concurrency.lockutils [None req-89aba908-48c2-4c67-a2c9-4a589c828cf1 None None] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:05:19.199739 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG oslo_concurrency.lockutils [None req-7b62a488-8d5c-4639-a258-8e44135fe589 None None] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:05:19.200002 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: INFO dbcounter [None req-89aba908-48c2-4c67-a2c9-4a589c828cf1 None None] Registered counter for database nova_cell0 Jul 22 11:05:19.201707 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: INFO dbcounter [None req-7b62a488-8d5c-4639-a258-8e44135fe589 None None] Registered counter for database nova_cell0 Jul 22 11:05:19.204498 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: INFO dbcounter [None req-89aba908-48c2-4c67-a2c9-4a589c828cf1 None None] Registered counter for database nova_cell1 Jul 22 11:05:19.205979 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: INFO dbcounter [None req-7b62a488-8d5c-4639-a258-8e44135fe589 None None] Registered counter for database nova_cell1 Jul 22 11:05:19.211919 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG oslo_db.sqlalchemy.engines [None req-89aba908-48c2-4c67-a2c9-4a589c828cf1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103399) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 22 11:05:19.213519 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG oslo_db.sqlalchemy.engines [None req-7b62a488-8d5c-4639-a258-8e44135fe589 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103398) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 22 11:05:19.216454 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG dbcounter [-] [103399] Writer thread running {{(pid=103399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 22 11:05:19.216780 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG oslo_db.sqlalchemy.engines [None req-7b62a488-8d5c-4639-a258-8e44135fe589 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103398) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 22 11:05:19.220542 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG dbcounter [-] [103398] Writer thread running {{(pid=103398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 22 11:05:19.349406 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG oslo_db.sqlalchemy.engines [None req-89aba908-48c2-4c67-a2c9-4a589c828cf1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103399) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 22 11:05:19.354793 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG dbcounter [-] [103399] Writer thread running {{(pid=103399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 22 11:05:19.357510 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG dbcounter [-] [103398] Writer thread running {{(pid=103398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 22 11:05:19.363840 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: INFO dbcounter [None req-89aba908-48c2-4c67-a2c9-4a589c828cf1 None None] Registered counter for database nova_cell0 Jul 22 11:05:19.366909 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: INFO dbcounter [None req-7b62a488-8d5c-4639-a258-8e44135fe589 None None] Registered counter for database nova_cell0 Jul 22 11:05:19.372417 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG oslo_db.sqlalchemy.engines [None req-89aba908-48c2-4c67-a2c9-4a589c828cf1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103399) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 22 11:05:19.376096 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG oslo_db.sqlalchemy.engines [None req-7b62a488-8d5c-4639-a258-8e44135fe589 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103398) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 22 11:05:19.376766 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG dbcounter [-] [103399] Writer thread running {{(pid=103399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 22 11:05:19.380515 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG dbcounter [-] [103398] Writer thread running {{(pid=103398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 22 11:05:19.715994 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: WARNING keystonemiddleware.auth_token [None req-89aba908-48c2-4c67-a2c9-4a589c828cf1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 22 11:05:19.721872 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: WARNING keystonemiddleware.auth_token [None req-7b62a488-8d5c-4639-a258-8e44135fe589 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 22 11:05:19.723242 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: WARNING keystonemiddleware.auth_token [None req-89aba908-48c2-4c67-a2c9-4a589c828cf1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 22 11:05:19.729127 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: WARNING keystonemiddleware.auth_token [None req-7b62a488-8d5c-4639-a258-8e44135fe589 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 22 11:05:20.069658 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: WARNING keystonemiddleware.auth_token [None req-89aba908-48c2-4c67-a2c9-4a589c828cf1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 22 11:05:20.075949 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: WARNING keystonemiddleware.auth_token [None req-89aba908-48c2-4c67-a2c9-4a589c828cf1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 22 11:05:20.076111 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: WARNING keystonemiddleware.auth_token [None req-7b62a488-8d5c-4639-a258-8e44135fe589 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 22 11:05:20.082558 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c628a529c0 pid: 103399 (default app) Jul 22 11:05:20.082695 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: WARNING keystonemiddleware.auth_token [None req-7b62a488-8d5c-4639-a258-8e44135fe589 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 22 11:05:20.084711 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi [None req-89aba908-48c2-4c67-a2c9-4a589c828cf1 None None] Calling method '>' {{(pid=103399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:05:20.085873 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: INFO nova.api.openstack.requestlog [None req-89aba908-48c2-4c67-a2c9-4a589c828cf1 None None] 10.222.0.20 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001773 Jul 22 11:05:20.086290 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: [pid: 103399|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 788 bytes} [Fri Jul 22 11:05:20 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:05:20.088771 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c628a529c0 pid: 103398 (default app) Jul 22 11:06:35.877565 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi [None req-89aba908-48c2-4c67-a2c9-4a589c828cf1 None None] Calling method '>' {{(pid=103399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:06:35.878873 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: INFO nova.api.openstack.requestlog [None req-89aba908-48c2-4c67-a2c9-4a589c828cf1 None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001730 Jul 22 11:06:35.879551 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: [pid: 103399|app: 0|req: 2/2] 10.222.0.20 () {54 vars in 930 bytes} [Fri Jul 22 11:06:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:06:35.893039 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG dbcounter [-] [103398] Writing DB stats nova_api:SELECT=3 {{(pid=103398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:06:35.894245 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG dbcounter [-] [103398] Writing DB stats nova_cell0:SELECT=3 {{(pid=103398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:06:35.895585 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG dbcounter [-] [103398] Writing DB stats nova_cell1:SELECT=3 {{(pid=103398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:06:35.896315 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG dbcounter [-] [103398] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:06:36.773650 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi [None req-c1fb9a21-2df0-41cc-99f7-b34fa69e23bc admin admin] Calling method '>' {{(pid=103398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:06:36.805089 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: INFO nova.api.openstack.requestlog [None req-c1fb9a21-2df0-41cc-99f7-b34fa69e23bc admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.918833 Jul 22 11:06:36.806077 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: [pid: 103398|app: 0|req: 1/3] 10.222.0.20 () {60 vars in 1291 bytes} [Fri Jul 22 11:06:35 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:06:39.027078 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi [None req-89aba908-48c2-4c67-a2c9-4a589c828cf1 None None] Calling method '>' {{(pid=103399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:06:39.028881 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: INFO nova.api.openstack.requestlog [None req-89aba908-48c2-4c67-a2c9-4a589c828cf1 None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002456 Jul 22 11:06:39.029913 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: [pid: 103399|app: 0|req: 3/4] 10.222.0.20 () {54 vars in 930 bytes} [Fri Jul 22 11:06:39 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:06:39.514164 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi [None req-d8dd8592-0f83-4f10-b9cd-85cbce27303c admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "disk": 1, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "id": "c1", "rxtx_factor": 1.0, "swap": 0}} {{(pid=103398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:06:39.532674 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 11:06:39.532674 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: warnings.warn(msg) Jul 22 11:06:39.560351 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: INFO nova.api.openstack.requestlog [None req-d8dd8592-0f83-4f10-b9cd-85cbce27303c admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.524639 Jul 22 11:06:39.560994 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: [pid: 103398|app: 0|req: 2/5] 10.222.0.20 () {64 vars in 1282 bytes} [Fri Jul 22 11:06:39 2022] POST /compute/v2.1/flavors => generated 407 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 22 11:06:39.575817 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG dbcounter [-] [103399] Writing DB stats nova_api:SELECT=3 {{(pid=103399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:06:39.576743 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG dbcounter [-] [103399] Writing DB stats nova_cell1:SELECT=3 {{(pid=103399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:06:39.577564 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG dbcounter [-] [103399] Writing DB stats nova_cell0:SELECT=3 {{(pid=103399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:06:39.578386 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG dbcounter [-] [103399] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:06:39.785739 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi [None req-7d2adc2e-15e6-49c0-b512-ab0b1959c2e9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:06:39.788185 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 11:06:39.788185 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: warnings.warn(msg) Jul 22 11:06:39.850905 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: INFO nova.api.openstack.requestlog [None req-7d2adc2e-15e6-49c0-b512-ab0b1959c2e9 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.281387 Jul 22 11:06:39.851699 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: [pid: 103399|app: 0|req: 4/6] 10.222.0.20 () {64 vars in 1335 bytes} [Fri Jul 22 11:06:39 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:06:42.123303 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi [None req-d8dd8592-0f83-4f10-b9cd-85cbce27303c admin admin] Calling method '>' {{(pid=103398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:06:42.124945 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: INFO nova.api.openstack.requestlog [None req-d8dd8592-0f83-4f10-b9cd-85cbce27303c admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002115 Jul 22 11:06:42.125777 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: [pid: 103398|app: 0|req: 3/7] 10.222.0.20 () {54 vars in 930 bytes} [Fri Jul 22 11:06:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:06:42.784360 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi [None req-912affde-e7c6-4a4e-8bbb-e8d5e76cf944 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "d1", "rxtx_factor": 1.0, "ram": 512, "disk": 5, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true}} {{(pid=103399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:06:42.802464 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 11:06:42.802464 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: warnings.warn(msg) Jul 22 11:06:42.824897 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: INFO nova.api.openstack.requestlog [None req-912affde-e7c6-4a4e-8bbb-e8d5e76cf944 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.693214 Jul 22 11:06:42.825545 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: [pid: 103399|app: 0|req: 5/8] 10.222.0.20 () {64 vars in 1282 bytes} [Fri Jul 22 11:06:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 22 11:06:42.837133 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi [None req-51230715-f0e4-4806-a29c-6342937caac4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:06:42.838797 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 11:06:42.838797 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: warnings.warn(msg) Jul 22 11:06:42.872957 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: INFO nova.api.openstack.requestlog [None req-51230715-f0e4-4806-a29c-6342937caac4 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039450 Jul 22 11:06:42.879405 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: [pid: 103398|app: 0|req: 4/9] 10.222.0.20 () {64 vars in 1335 bytes} [Fri Jul 22 11:06:42 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:06:45.122620 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi [None req-912affde-e7c6-4a4e-8bbb-e8d5e76cf944 admin admin] Calling method '>' {{(pid=103399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:06:45.123904 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: INFO nova.api.openstack.requestlog [None req-912affde-e7c6-4a4e-8bbb-e8d5e76cf944 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001621 Jul 22 11:06:45.124580 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: [pid: 103399|app: 0|req: 6/10] 10.222.0.20 () {54 vars in 930 bytes} [Fri Jul 22 11:06:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:06:45.530403 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi [None req-72e9827c-3a88-4f92-a2af-773c1fdcfd3c admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 10, "name": "ds1G", "ram": 1024, "id": "d2", "vcpus": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=103398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:06:45.548758 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: INFO nova.api.openstack.requestlog [None req-72e9827c-3a88-4f92-a2af-773c1fdcfd3c admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.417758 Jul 22 11:06:45.549232 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: [pid: 103398|app: 0|req: 5/11] 10.222.0.20 () {64 vars in 1282 bytes} [Fri Jul 22 11:06:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 22 11:06:45.561121 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi [None req-47ee735a-7cf4-4013-9d39-dcce8d7b0866 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:06:45.583913 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: INFO nova.api.openstack.requestlog [None req-47ee735a-7cf4-4013-9d39-dcce8d7b0866 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026432 Jul 22 11:06:45.584562 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: [pid: 103399|app: 0|req: 7/12] 10.222.0.20 () {64 vars in 1335 bytes} [Fri Jul 22 11:06:45 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:06:47.794968 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi [None req-72e9827c-3a88-4f92-a2af-773c1fdcfd3c admin admin] Calling method '>' {{(pid=103398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:06:47.796005 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: INFO nova.api.openstack.requestlog [None req-72e9827c-3a88-4f92-a2af-773c1fdcfd3c admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Jul 22 11:06:47.797009 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: [pid: 103398|app: 0|req: 6/13] 10.222.0.20 () {54 vars in 930 bytes} [Fri Jul 22 11:06:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:06:48.219044 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi [None req-ed6fa768-4020-477e-bc34-8ee54a8c4a5e admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "name": "ds2G", "swap": 0, "os-flavor-access:is_public": true, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "d3", "ram": 2048}} {{(pid=103399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:06:48.245525 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: INFO nova.api.openstack.requestlog [None req-ed6fa768-4020-477e-bc34-8ee54a8c4a5e admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.436454 Jul 22 11:06:48.249209 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: [pid: 103399|app: 0|req: 8/14] 10.222.0.20 () {64 vars in 1282 bytes} [Fri Jul 22 11:06:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 22 11:06:48.260396 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi [None req-a8cc3ab8-c745-47f5-94c9-6c94026bb128 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:06:48.289437 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: INFO nova.api.openstack.requestlog [None req-a8cc3ab8-c745-47f5-94c9-6c94026bb128 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032985 Jul 22 11:06:48.290672 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: [pid: 103398|app: 0|req: 7/15] 10.222.0.20 () {64 vars in 1335 bytes} [Fri Jul 22 11:06:48 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:06:50.559699 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi [None req-ed6fa768-4020-477e-bc34-8ee54a8c4a5e admin admin] Calling method '>' {{(pid=103399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:06:50.560647 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: INFO nova.api.openstack.requestlog [None req-ed6fa768-4020-477e-bc34-8ee54a8c4a5e admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Jul 22 11:06:50.563554 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: [pid: 103399|app: 0|req: 9/16] 10.222.0.20 () {54 vars in 930 bytes} [Fri Jul 22 11:06:50 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:06:51.011578 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi [None req-af9fa4c2-7359-4358-808d-86e734a0bbf5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "name": "ds4G", "id": "d4", "ram": 4096, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 4}} {{(pid=103398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:06:51.030407 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: INFO nova.api.openstack.requestlog [None req-af9fa4c2-7359-4358-808d-86e734a0bbf5 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.463674 Jul 22 11:06:51.031675 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: [pid: 103398|app: 0|req: 8/17] 10.222.0.20 () {64 vars in 1282 bytes} [Fri Jul 22 11:06:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 22 11:06:51.043844 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi [None req-e81a8ab4-7fa0-4762-9459-8f0d0e7fdbdf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:06:51.067454 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: INFO nova.api.openstack.requestlog [None req-e81a8ab4-7fa0-4762-9459-8f0d0e7fdbdf admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027826 Jul 22 11:06:51.068128 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: [pid: 103399|app: 0|req: 10/18] 10.222.0.20 () {64 vars in 1335 bytes} [Fri Jul 22 11:06:51 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:06:53.427969 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi [None req-af9fa4c2-7359-4358-808d-86e734a0bbf5 admin admin] Calling method '>' {{(pid=103398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:06:53.429258 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: INFO nova.api.openstack.requestlog [None req-af9fa4c2-7359-4358-808d-86e734a0bbf5 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001893 Jul 22 11:06:53.429897 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: [pid: 103398|app: 0|req: 9/19] 10.222.0.20 () {54 vars in 930 bytes} [Fri Jul 22 11:06:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:06:53.853006 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi [None req-e9ec1c4a-b97e-432f-a0e0-d0da51d487f6 admin admin] Calling method '>' {{(pid=103399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:06:53.876479 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: INFO nova.api.openstack.requestlog [None req-e9ec1c4a-b97e-432f-a0e0-d0da51d487f6 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.437908 Jul 22 11:06:53.877009 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: [pid: 103399|app: 0|req: 11/20] 10.222.0.20 () {60 vars in 1291 bytes} [Fri Jul 22 11:06:53 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:06:56.160295 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi [None req-af9fa4c2-7359-4358-808d-86e734a0bbf5 admin admin] Calling method '>' {{(pid=103398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:06:56.161606 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: INFO nova.api.openstack.requestlog [None req-af9fa4c2-7359-4358-808d-86e734a0bbf5 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001946 Jul 22 11:06:56.162091 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: [pid: 103398|app: 0|req: 10/21] 10.222.0.20 () {54 vars in 930 bytes} [Fri Jul 22 11:06:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:06:56.605139 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi [None req-13812f83-db04-414f-8b97-93b9433006d6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "disk": 1, "name": "m1.tiny", "id": "1", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=103399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:06:56.625472 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: INFO nova.api.openstack.requestlog [None req-13812f83-db04-414f-8b97-93b9433006d6 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.455878 Jul 22 11:06:56.626039 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: [pid: 103399|app: 0|req: 12/22] 10.222.0.20 () {64 vars in 1282 bytes} [Fri Jul 22 11:06:56 2022] POST /compute/v2.1/flavors => generated 402 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 22 11:06:56.643720 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi [None req-3a627b78-e8a0-4b97-9399-ce03550dceca admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:06:56.667641 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: INFO nova.api.openstack.requestlog [None req-3a627b78-e8a0-4b97-9399-ce03550dceca admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027508 Jul 22 11:06:56.668230 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: [pid: 103398|app: 0|req: 11/23] 10.222.0.20 () {64 vars in 1332 bytes} [Fri Jul 22 11:06:56 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:06:59.242838 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi [None req-13812f83-db04-414f-8b97-93b9433006d6 admin admin] Calling method '>' {{(pid=103399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:06:59.243884 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: INFO nova.api.openstack.requestlog [None req-13812f83-db04-414f-8b97-93b9433006d6 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Jul 22 11:06:59.244410 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: [pid: 103399|app: 0|req: 13/24] 10.222.0.20 () {54 vars in 930 bytes} [Fri Jul 22 11:06:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:06:59.649962 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi [None req-16a5a934-5b22-4ad4-9310-dbd439b3d9ea admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "id": "2", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 2048, "disk": 20}} {{(pid=103398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:06:59.667988 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: INFO nova.api.openstack.requestlog [None req-16a5a934-5b22-4ad4-9310-dbd439b3d9ea admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.417539 Jul 22 11:06:59.668470 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: [pid: 103398|app: 0|req: 12/25] 10.222.0.20 () {64 vars in 1282 bytes} [Fri Jul 22 11:06:59 2022] POST /compute/v2.1/flavors => generated 405 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 22 11:06:59.683029 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi [None req-6d2500b8-edab-4b27-900f-1cd1ecdd66a3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:06:59.705326 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: INFO nova.api.openstack.requestlog [None req-6d2500b8-edab-4b27-900f-1cd1ecdd66a3 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028047 Jul 22 11:06:59.705878 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: [pid: 103399|app: 0|req: 14/26] 10.222.0.20 () {64 vars in 1332 bytes} [Fri Jul 22 11:06:59 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:07:01.965317 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi [None req-16a5a934-5b22-4ad4-9310-dbd439b3d9ea admin admin] Calling method '>' {{(pid=103398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:07:01.966309 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: INFO nova.api.openstack.requestlog [None req-16a5a934-5b22-4ad4-9310-dbd439b3d9ea admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Jul 22 11:07:01.966711 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: [pid: 103398|app: 0|req: 13/27] 10.222.0.20 () {54 vars in 930 bytes} [Fri Jul 22 11:07:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:07:02.358966 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi [None req-a5501cdc-044c-4932-a869-c3869129f7ca admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "ram": 4096, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 2, "disk": 40, "id": "3"}} {{(pid=103399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:07:02.378446 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: INFO nova.api.openstack.requestlog [None req-a5501cdc-044c-4932-a869-c3869129f7ca admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.405692 Jul 22 11:07:02.379334 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: [pid: 103399|app: 0|req: 15/28] 10.222.0.20 () {64 vars in 1282 bytes} [Fri Jul 22 11:07:01 2022] POST /compute/v2.1/flavors => generated 406 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 22 11:07:02.390890 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi [None req-fbf08775-7522-4722-a72f-38aee547dbdb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:07:02.415457 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: INFO nova.api.openstack.requestlog [None req-fbf08775-7522-4722-a72f-38aee547dbdb admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028149 Jul 22 11:07:02.424518 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: [pid: 103398|app: 0|req: 14/29] 10.222.0.20 () {64 vars in 1332 bytes} [Fri Jul 22 11:07:02 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:07:04.645259 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi [None req-a5501cdc-044c-4932-a869-c3869129f7ca admin admin] Calling method '>' {{(pid=103399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:07:04.646266 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: INFO nova.api.openstack.requestlog [None req-a5501cdc-044c-4932-a869-c3869129f7ca admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Jul 22 11:07:04.646835 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: [pid: 103399|app: 0|req: 16/30] 10.222.0.20 () {54 vars in 930 bytes} [Fri Jul 22 11:07:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:07:05.085274 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi [None req-ce79f9e6-35af-467e-8455-46a80de6d9fc admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "id": "4", "swap": 0, "rxtx_factor": 1.0, "vcpus": 4, "os-flavor-access:is_public": true, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192}} {{(pid=103398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:07:05.107076 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: INFO nova.api.openstack.requestlog [None req-ce79f9e6-35af-467e-8455-46a80de6d9fc admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.454252 Jul 22 11:07:05.107663 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: [pid: 103398|app: 0|req: 15/31] 10.222.0.20 () {64 vars in 1282 bytes} [Fri Jul 22 11:07:04 2022] POST /compute/v2.1/flavors => generated 405 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 22 11:07:05.120578 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi [None req-9eac472b-a069-48da-a20f-2163d30ba79c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:07:05.151356 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: INFO nova.api.openstack.requestlog [None req-9eac472b-a069-48da-a20f-2163d30ba79c admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035038 Jul 22 11:07:05.153652 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: [pid: 103399|app: 0|req: 17/32] 10.222.0.20 () {64 vars in 1332 bytes} [Fri Jul 22 11:07:05 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:07:07.440575 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi [None req-ce79f9e6-35af-467e-8455-46a80de6d9fc admin admin] Calling method '>' {{(pid=103398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:07:07.442811 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: INFO nova.api.openstack.requestlog [None req-ce79f9e6-35af-467e-8455-46a80de6d9fc admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002705 Jul 22 11:07:07.448079 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: [pid: 103398|app: 0|req: 16/33] 10.222.0.20 () {54 vars in 930 bytes} [Fri Jul 22 11:07:07 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:07:07.925971 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi [None req-fe87a5bf-ce55-4a3a-93cf-db00d0f5d010 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "5", "ram": 16384, "rxtx_factor": 1.0, "swap": 0, "disk": 160, "vcpus": 8, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:07:07.949968 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: INFO nova.api.openstack.requestlog [None req-fe87a5bf-ce55-4a3a-93cf-db00d0f5d010 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.500029 Jul 22 11:07:07.960768 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: [pid: 103399|app: 0|req: 18/34] 10.222.0.20 () {64 vars in 1282 bytes} [Fri Jul 22 11:07:07 2022] POST /compute/v2.1/flavors => generated 408 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 22 11:07:07.965313 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi [None req-d8abad35-c073-4fb8-bf4b-e4d2dc307b23 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:07:07.972587 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG dbcounter [-] [103398] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:07:07.992839 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: INFO nova.api.openstack.requestlog [None req-d8abad35-c073-4fb8-bf4b-e4d2dc307b23 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031016 Jul 22 11:07:07.993564 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: [pid: 103398|app: 0|req: 17/35] 10.222.0.20 () {64 vars in 1332 bytes} [Fri Jul 22 11:07:07 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:07:27.602312 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi [None req-fe87a5bf-ce55-4a3a-93cf-db00d0f5d010 admin admin] Calling method '>' {{(pid=103399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:07:27.603855 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: INFO nova.api.openstack.requestlog [None req-fe87a5bf-ce55-4a3a-93cf-db00d0f5d010 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Jul 22 11:07:27.604461 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: [pid: 103399|app: 0|req: 19/36] 10.222.0.20 () {54 vars in 930 bytes} [Fri Jul 22 11:07:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:07:27.988170 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi [None req-9cebc67a-d69c-4a93-a850-8edbb6bee4ec admin admin] Calling method '>' {{(pid=103398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:07:28.004556 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: INFO nova.api.openstack.requestlog [None req-9cebc67a-d69c-4a93-a850-8edbb6bee4ec admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.394156 Jul 22 11:07:28.005082 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: [pid: 103398|app: 0|req: 18/37] 10.222.0.20 () {60 vars in 1291 bytes} [Fri Jul 22 11:07:27 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:07:29.059677 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi [None req-fe87a5bf-ce55-4a3a-93cf-db00d0f5d010 admin admin] Calling method '>' {{(pid=103399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:07:29.060676 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: INFO nova.api.openstack.requestlog [None req-fe87a5bf-ce55-4a3a-93cf-db00d0f5d010 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Jul 22 11:07:29.061068 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: [pid: 103399|app: 0|req: 20/38] 10.222.0.20 () {56 vars in 1074 bytes} [Fri Jul 22 11:07:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:07:29.572439 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi [None req-adb6c404-a034-4f5c-bd6f-7c4c3c59b8b4 admin admin] Calling method '>' {{(pid=103398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:07:29.579403 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: INFO nova.api.openstack.wsgi [None req-adb6c404-a034-4f5c-bd6f-7c4c3c59b8b4 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 22 11:07:29.582764 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi [None req-adb6c404-a034-4f5c-bd6f-7c4c3c59b8b4 admin admin] Request method failure captured: Jul 22 11:07:29.582764 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 22 11:07:29.582764 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: Accept: application/json Jul 22 11:07:29.582764 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: Accept-Encoding: gzip, deflate Jul 22 11:07:29.582764 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: Connection: keep-alive Jul 22 11:07:29.582764 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: Content-Length: 0 Jul 22 11:07:29.582764 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: Host: 10.222.0.20 Jul 22 11:07:29.582764 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: Openstack-Api-Version: compute 2.90 Jul 22 11:07:29.582764 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: Openstack-System-Scope: None Jul 22 11:07:29.582764 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: User-Agent: python-novaclient Jul 22 11:07:29.582764 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: X-Auth-Token: gAAAAABi2oTwaVycgOlqqVLuhtV7ifv6oPdDE_AHkKJi7tDFVhgwZbIUYzyvcPQEnCMK5vCEUksQf1qh7W-BeeQwiqy84dQdfYaBi7BBdwMdsPSJjJ2i5Rjhcc9TPw8FacJ27n-JEXb1t0mQ-6e3L3RieYhsBGFboflJb5uOwVoD7b5Vk4GDOqo Jul 22 11:07:29.582764 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: X-Domain-Id: None Jul 22 11:07:29.582764 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: X-Domain-Name: None Jul 22 11:07:29.582764 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: X-Identity-Status: Confirmed Jul 22 11:07:29.582764 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: X-Is-Admin-Project: True Jul 22 11:07:29.582764 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: X-Openstack-Nova-Api-Version: 2.90 Jul 22 11:07:29.582764 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: X-Project-Domain-Id: default Jul 22 11:07:29.582764 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: X-Project-Domain-Name: Default Jul 22 11:07:29.582764 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: X-Project-Id: a25f160b71984d6fbacad5d6c1f3248c Jul 22 11:07:29.582764 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: X-Project-Name: admin Jul 22 11:07:29.582764 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: X-Role: reader,member,admin Jul 22 11:07:29.582764 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: X-Roles: reader,member,admin Jul 22 11:07:29.584227 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a25f160b71984d6fbacad5d6c1f3248c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a25f160b71984d6fbacad5d6c1f3248c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a25f160b71984d6fbacad5d6c1f3248c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a25f160b71984d6fbacad5d6c1f3248c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jul 22 11:07:29.584227 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: X-Tenant: admin Jul 22 11:07:29.584227 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: X-Tenant-Id: a25f160b71984d6fbacad5d6c1f3248c Jul 22 11:07:29.584227 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: X-Tenant-Name: admin Jul 22 11:07:29.584227 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: X-User: admin Jul 22 11:07:29.584227 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: X-User-Domain-Id: default Jul 22 11:07:29.584227 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: X-User-Domain-Name: Default Jul 22 11:07:29.584227 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: X-User-Id: 9a8c4f38edad4724ac733753692dda22 Jul 22 11:07:29.584227 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: X-User-Name: admin Jul 22 11:07:29.584227 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: method: > Jul 22 11:07:29.584227 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: exception: Flavor 42 could not be found. Jul 22 11:07:29.584227 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: action_args: {'id': '42'} Jul 22 11:07:29.584227 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: {{(pid=103398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 22 11:07:29.584227 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:07:29.585074 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 22 11:07:29.585074 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 22 11:07:29.585074 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 22 11:07:29.585074 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 22 11:07:29.585074 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 22 11:07:29.585074 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 22 11:07:29.585074 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 22 11:07:29.585074 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 22 11:07:29.585074 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 22 11:07:29.585074 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 22 11:07:29.585074 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 22 11:07:29.585074 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 22 11:07:29.585074 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 22 11:07:29.585074 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi Jul 22 11:07:29.585074 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:07:29.585074 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi Jul 22 11:07:29.585074 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:07:29.585074 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:07:29.585074 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:07:29.586317 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 22 11:07:29.586317 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 22 11:07:29.586317 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 22 11:07:29.586317 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 22 11:07:29.586317 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 22 11:07:29.586317 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 22 11:07:29.586317 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 22 11:07:29.586317 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi Jul 22 11:07:29.586317 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:07:29.586317 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi Jul 22 11:07:29.586317 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:07:29.586317 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:07:29.586317 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:07:29.586317 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 22 11:07:29.586317 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 22 11:07:29.586317 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 22 11:07:29.586317 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi Jul 22 11:07:29.586317 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi [None req-adb6c404-a034-4f5c-bd6f-7c4c3c59b8b4 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103398) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 22 11:07:29.588166 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: INFO nova.api.openstack.requestlog [None req-adb6c404-a034-4f5c-bd6f-7c4c3c59b8b4 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.387378 Jul 22 11:07:29.588166 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: [pid: 103398|app: 0|req: 19/39] 10.222.0.20 () {60 vars in 1190 bytes} [Fri Jul 22 11:07:29 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 389 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 22 11:07:29.594824 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi [None req-628e1051-a37e-4ced-8df8-63869cf1fb7a admin admin] Calling method '>' {{(pid=103399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:07:29.597799 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG dbcounter [-] [103399] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:07:29.618320 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: INFO nova.api.openstack.requestlog [None req-628e1051-a37e-4ced-8df8-63869cf1fb7a admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027118 Jul 22 11:07:29.618911 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: [pid: 103399|app: 0|req: 21/40] 10.222.0.20 () {60 vars in 1210 bytes} [Fri Jul 22 11:07:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:07:29.628764 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi [None req-89f648b6-0718-42f6-bb0a-51df5190952d admin admin] Calling method '>' {{(pid=103398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:07:29.649234 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: INFO nova.api.openstack.requestlog [None req-89f648b6-0718-42f6-bb0a-51df5190952d admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024059 Jul 22 11:07:29.649746 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: [pid: 103398|app: 0|req: 20/41] 10.222.0.20 () {60 vars in 1210 bytes} [Fri Jul 22 11:07:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 22 11:07:29.660318 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi [None req-d447f530-c6cc-492c-a275-afbd308f10e8 admin admin] Calling method '>' {{(pid=103399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:07:29.666992 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: INFO nova.api.openstack.wsgi [None req-d447f530-c6cc-492c-a275-afbd308f10e8 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 22 11:07:29.670252 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi [None req-d447f530-c6cc-492c-a275-afbd308f10e8 admin admin] Request method failure captured: Jul 22 11:07:29.670252 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 22 11:07:29.670252 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: Accept: application/json Jul 22 11:07:29.670252 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: Accept-Encoding: gzip, deflate Jul 22 11:07:29.670252 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: Connection: keep-alive Jul 22 11:07:29.670252 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: Content-Length: 0 Jul 22 11:07:29.670252 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: Host: 10.222.0.20 Jul 22 11:07:29.670252 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: Openstack-Api-Version: compute 2.90 Jul 22 11:07:29.670252 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: Openstack-System-Scope: None Jul 22 11:07:29.670252 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: User-Agent: python-novaclient Jul 22 11:07:29.670252 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: X-Auth-Token: gAAAAABi2oTwaVycgOlqqVLuhtV7ifv6oPdDE_AHkKJi7tDFVhgwZbIUYzyvcPQEnCMK5vCEUksQf1qh7W-BeeQwiqy84dQdfYaBi7BBdwMdsPSJjJ2i5Rjhcc9TPw8FacJ27n-JEXb1t0mQ-6e3L3RieYhsBGFboflJb5uOwVoD7b5Vk4GDOqo Jul 22 11:07:29.670252 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: X-Domain-Id: None Jul 22 11:07:29.670252 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: X-Domain-Name: None Jul 22 11:07:29.670252 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: X-Identity-Status: Confirmed Jul 22 11:07:29.670252 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: X-Is-Admin-Project: True Jul 22 11:07:29.670252 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: X-Openstack-Nova-Api-Version: 2.90 Jul 22 11:07:29.670252 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: X-Project-Domain-Id: default Jul 22 11:07:29.670252 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: X-Project-Domain-Name: Default Jul 22 11:07:29.670252 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: X-Project-Id: a25f160b71984d6fbacad5d6c1f3248c Jul 22 11:07:29.670252 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: X-Project-Name: admin Jul 22 11:07:29.670252 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: X-Role: reader,member,admin Jul 22 11:07:29.670252 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: X-Roles: reader,member,admin Jul 22 11:07:29.671900 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a25f160b71984d6fbacad5d6c1f3248c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a25f160b71984d6fbacad5d6c1f3248c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a25f160b71984d6fbacad5d6c1f3248c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a25f160b71984d6fbacad5d6c1f3248c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jul 22 11:07:29.671900 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: X-Tenant: admin Jul 22 11:07:29.671900 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: X-Tenant-Id: a25f160b71984d6fbacad5d6c1f3248c Jul 22 11:07:29.671900 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: X-Tenant-Name: admin Jul 22 11:07:29.671900 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: X-User: admin Jul 22 11:07:29.671900 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: X-User-Domain-Id: default Jul 22 11:07:29.671900 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: X-User-Domain-Name: Default Jul 22 11:07:29.671900 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: X-User-Id: 9a8c4f38edad4724ac733753692dda22 Jul 22 11:07:29.671900 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: X-User-Name: admin Jul 22 11:07:29.671900 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: method: > Jul 22 11:07:29.671900 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: exception: Flavor 42 could not be found. Jul 22 11:07:29.671900 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: action_args: {'id': '42'} Jul 22 11:07:29.671900 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: {{(pid=103399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 22 11:07:29.671900 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:07:29.672849 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 22 11:07:29.672849 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 22 11:07:29.672849 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 22 11:07:29.672849 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 22 11:07:29.672849 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 22 11:07:29.672849 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 22 11:07:29.672849 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 22 11:07:29.672849 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 22 11:07:29.672849 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 22 11:07:29.672849 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 22 11:07:29.672849 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 22 11:07:29.672849 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 22 11:07:29.672849 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 22 11:07:29.672849 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi Jul 22 11:07:29.672849 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:07:29.672849 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi Jul 22 11:07:29.672849 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:07:29.672849 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:07:29.672849 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:07:29.674087 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 22 11:07:29.674087 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 22 11:07:29.674087 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 22 11:07:29.674087 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 22 11:07:29.674087 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 22 11:07:29.674087 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 22 11:07:29.674087 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 22 11:07:29.674087 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi Jul 22 11:07:29.674087 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:07:29.674087 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi Jul 22 11:07:29.674087 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:07:29.674087 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:07:29.674087 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:07:29.674087 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 22 11:07:29.674087 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 22 11:07:29.674087 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 22 11:07:29.674087 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi Jul 22 11:07:29.674087 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi [None req-d447f530-c6cc-492c-a275-afbd308f10e8 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 22 11:07:29.675346 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: INFO nova.api.openstack.requestlog [None req-d447f530-c6cc-492c-a275-afbd308f10e8 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015817 Jul 22 11:07:29.675346 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: [pid: 103399|app: 0|req: 22/42] 10.222.0.20 () {60 vars in 1190 bytes} [Fri Jul 22 11:07:29 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 22 11:07:30.648734 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi [None req-89f648b6-0718-42f6-bb0a-51df5190952d admin admin] Calling method '>' {{(pid=103398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:07:30.649768 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: INFO nova.api.openstack.requestlog [None req-89f648b6-0718-42f6-bb0a-51df5190952d admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Jul 22 11:07:30.650158 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: [pid: 103398|app: 0|req: 21/43] 10.222.0.20 () {56 vars in 1074 bytes} [Fri Jul 22 11:07:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:07:31.159483 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi [None req-54980fb7-1fcb-4aac-9059-4a82bf77f449 admin admin] Calling method '>' {{(pid=103399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:07:31.164694 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: INFO nova.api.openstack.wsgi [None req-54980fb7-1fcb-4aac-9059-4a82bf77f449 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 22 11:07:31.166193 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi [None req-54980fb7-1fcb-4aac-9059-4a82bf77f449 admin admin] Request method failure captured: Jul 22 11:07:31.166193 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 22 11:07:31.166193 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: Accept: application/json Jul 22 11:07:31.166193 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: Accept-Encoding: gzip, deflate Jul 22 11:07:31.166193 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: Connection: keep-alive Jul 22 11:07:31.166193 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: Content-Length: 0 Jul 22 11:07:31.166193 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: Host: 10.222.0.20 Jul 22 11:07:31.166193 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: Openstack-Api-Version: compute 2.90 Jul 22 11:07:31.166193 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: Openstack-System-Scope: None Jul 22 11:07:31.166193 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: User-Agent: python-novaclient Jul 22 11:07:31.166193 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: X-Auth-Token: gAAAAABi2oTyHAbh9xxDMOTw54trPLX4tpwAjf631geV2-ystVFaDwAWj0EmIeRN7giqP5l9OM6Wi8iMDu1oO-7jo4y_4A32JQj9dWxDBP4M2rbj6oUU6-UYqD58BGZHzR4JAEiba9ym-EMtC3OgS_hzEMy5YT2rC2fTSLbyeBoiG7Bxw2cPGF0 Jul 22 11:07:31.166193 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: X-Domain-Id: None Jul 22 11:07:31.166193 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: X-Domain-Name: None Jul 22 11:07:31.166193 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: X-Identity-Status: Confirmed Jul 22 11:07:31.166193 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: X-Is-Admin-Project: True Jul 22 11:07:31.166193 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: X-Openstack-Nova-Api-Version: 2.90 Jul 22 11:07:31.166193 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: X-Project-Domain-Id: default Jul 22 11:07:31.166193 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: X-Project-Domain-Name: Default Jul 22 11:07:31.166193 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: X-Project-Id: a25f160b71984d6fbacad5d6c1f3248c Jul 22 11:07:31.166193 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: X-Project-Name: admin Jul 22 11:07:31.166193 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: X-Role: reader,member,admin Jul 22 11:07:31.166193 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: X-Roles: reader,member,admin Jul 22 11:07:31.167718 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a25f160b71984d6fbacad5d6c1f3248c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a25f160b71984d6fbacad5d6c1f3248c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a25f160b71984d6fbacad5d6c1f3248c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a25f160b71984d6fbacad5d6c1f3248c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jul 22 11:07:31.167718 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: X-Tenant: admin Jul 22 11:07:31.167718 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: X-Tenant-Id: a25f160b71984d6fbacad5d6c1f3248c Jul 22 11:07:31.167718 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: X-Tenant-Name: admin Jul 22 11:07:31.167718 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: X-User: admin Jul 22 11:07:31.167718 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: X-User-Domain-Id: default Jul 22 11:07:31.167718 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: X-User-Domain-Name: Default Jul 22 11:07:31.167718 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: X-User-Id: 9a8c4f38edad4724ac733753692dda22 Jul 22 11:07:31.167718 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: X-User-Name: admin Jul 22 11:07:31.167718 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: method: > Jul 22 11:07:31.167718 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: exception: Flavor 84 could not be found. Jul 22 11:07:31.167718 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: action_args: {'id': '84'} Jul 22 11:07:31.167718 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: {{(pid=103399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 22 11:07:31.167718 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:07:31.168682 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 22 11:07:31.168682 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 22 11:07:31.168682 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 22 11:07:31.168682 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 22 11:07:31.168682 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 22 11:07:31.168682 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 22 11:07:31.168682 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 22 11:07:31.168682 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 22 11:07:31.168682 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 22 11:07:31.168682 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 22 11:07:31.168682 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 22 11:07:31.168682 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 22 11:07:31.168682 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 22 11:07:31.168682 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi Jul 22 11:07:31.168682 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:07:31.168682 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi Jul 22 11:07:31.168682 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:07:31.168682 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:07:31.168682 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:07:31.169995 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 22 11:07:31.169995 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 22 11:07:31.169995 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 22 11:07:31.169995 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 22 11:07:31.169995 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 22 11:07:31.169995 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 22 11:07:31.169995 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 22 11:07:31.169995 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi Jul 22 11:07:31.169995 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:07:31.169995 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi Jul 22 11:07:31.169995 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:07:31.169995 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:07:31.169995 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:07:31.169995 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 22 11:07:31.169995 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 22 11:07:31.169995 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 22 11:07:31.169995 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi Jul 22 11:07:31.169995 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi [None req-54980fb7-1fcb-4aac-9059-4a82bf77f449 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 22 11:07:31.171252 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: INFO nova.api.openstack.requestlog [None req-54980fb7-1fcb-4aac-9059-4a82bf77f449 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.381463 Jul 22 11:07:31.171252 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: [pid: 103399|app: 0|req: 23/44] 10.222.0.20 () {60 vars in 1190 bytes} [Fri Jul 22 11:07:30 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 383 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 22 11:07:31.177158 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi [None req-5b38ad6e-9ac1-445d-be9c-835136c969d4 admin admin] Calling method '>' {{(pid=103398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:07:31.190487 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: INFO nova.api.openstack.requestlog [None req-5b38ad6e-9ac1-445d-be9c-835136c969d4 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016981 Jul 22 11:07:31.191002 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: [pid: 103398|app: 0|req: 22/45] 10.222.0.20 () {60 vars in 1210 bytes} [Fri Jul 22 11:07:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:07:31.200525 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi [None req-7a3f03a1-3d78-4470-a887-1333d21ee895 admin admin] Calling method '>' {{(pid=103399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:07:31.214601 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: INFO nova.api.openstack.requestlog [None req-7a3f03a1-3d78-4470-a887-1333d21ee895 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017434 Jul 22 11:07:31.215107 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: [pid: 103399|app: 0|req: 24/46] 10.222.0.20 () {60 vars in 1210 bytes} [Fri Jul 22 11:07:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:07:31.223959 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi [None req-10d2f6aa-bf90-4e29-b81a-5d1e53c06699 admin admin] Calling method '>' {{(pid=103398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:07:31.229083 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: INFO nova.api.openstack.wsgi [None req-10d2f6aa-bf90-4e29-b81a-5d1e53c06699 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 22 11:07:31.230604 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi [None req-10d2f6aa-bf90-4e29-b81a-5d1e53c06699 admin admin] Request method failure captured: Jul 22 11:07:31.230604 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 22 11:07:31.230604 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: Accept: application/json Jul 22 11:07:31.230604 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: Accept-Encoding: gzip, deflate Jul 22 11:07:31.230604 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: Connection: keep-alive Jul 22 11:07:31.230604 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: Content-Length: 0 Jul 22 11:07:31.230604 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: Host: 10.222.0.20 Jul 22 11:07:31.230604 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: Openstack-Api-Version: compute 2.90 Jul 22 11:07:31.230604 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: Openstack-System-Scope: None Jul 22 11:07:31.230604 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: User-Agent: python-novaclient Jul 22 11:07:31.230604 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: X-Auth-Token: gAAAAABi2oTyHAbh9xxDMOTw54trPLX4tpwAjf631geV2-ystVFaDwAWj0EmIeRN7giqP5l9OM6Wi8iMDu1oO-7jo4y_4A32JQj9dWxDBP4M2rbj6oUU6-UYqD58BGZHzR4JAEiba9ym-EMtC3OgS_hzEMy5YT2rC2fTSLbyeBoiG7Bxw2cPGF0 Jul 22 11:07:31.230604 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: X-Domain-Id: None Jul 22 11:07:31.230604 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: X-Domain-Name: None Jul 22 11:07:31.230604 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: X-Identity-Status: Confirmed Jul 22 11:07:31.230604 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: X-Is-Admin-Project: True Jul 22 11:07:31.230604 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: X-Openstack-Nova-Api-Version: 2.90 Jul 22 11:07:31.230604 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: X-Project-Domain-Id: default Jul 22 11:07:31.230604 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: X-Project-Domain-Name: Default Jul 22 11:07:31.230604 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: X-Project-Id: a25f160b71984d6fbacad5d6c1f3248c Jul 22 11:07:31.230604 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: X-Project-Name: admin Jul 22 11:07:31.230604 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: X-Role: reader,member,admin Jul 22 11:07:31.230604 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: X-Roles: reader,member,admin Jul 22 11:07:31.232127 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a25f160b71984d6fbacad5d6c1f3248c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a25f160b71984d6fbacad5d6c1f3248c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a25f160b71984d6fbacad5d6c1f3248c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a25f160b71984d6fbacad5d6c1f3248c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jul 22 11:07:31.232127 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: X-Tenant: admin Jul 22 11:07:31.232127 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: X-Tenant-Id: a25f160b71984d6fbacad5d6c1f3248c Jul 22 11:07:31.232127 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: X-Tenant-Name: admin Jul 22 11:07:31.232127 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: X-User: admin Jul 22 11:07:31.232127 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: X-User-Domain-Id: default Jul 22 11:07:31.232127 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: X-User-Domain-Name: Default Jul 22 11:07:31.232127 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: X-User-Id: 9a8c4f38edad4724ac733753692dda22 Jul 22 11:07:31.232127 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: X-User-Name: admin Jul 22 11:07:31.232127 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: method: > Jul 22 11:07:31.232127 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: exception: Flavor 84 could not be found. Jul 22 11:07:31.232127 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: action_args: {'id': '84'} Jul 22 11:07:31.232127 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: {{(pid=103398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 22 11:07:31.232127 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:07:31.233085 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 22 11:07:31.233085 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 22 11:07:31.233085 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 22 11:07:31.233085 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 22 11:07:31.233085 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 22 11:07:31.233085 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 22 11:07:31.233085 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 22 11:07:31.233085 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 22 11:07:31.233085 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 22 11:07:31.233085 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 22 11:07:31.233085 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 22 11:07:31.233085 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 22 11:07:31.233085 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 22 11:07:31.233085 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi Jul 22 11:07:31.233085 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:07:31.233085 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi Jul 22 11:07:31.233085 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:07:31.233085 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:07:31.233085 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:07:31.234443 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 22 11:07:31.234443 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 22 11:07:31.234443 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 22 11:07:31.234443 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 22 11:07:31.234443 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 22 11:07:31.234443 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 22 11:07:31.234443 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 22 11:07:31.234443 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi Jul 22 11:07:31.234443 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:07:31.234443 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi Jul 22 11:07:31.234443 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:07:31.234443 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:07:31.234443 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:07:31.234443 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 22 11:07:31.234443 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 22 11:07:31.234443 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 22 11:07:31.234443 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi Jul 22 11:07:31.234443 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi [None req-10d2f6aa-bf90-4e29-b81a-5d1e53c06699 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103398) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 22 11:07:31.235722 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: INFO nova.api.openstack.requestlog [None req-10d2f6aa-bf90-4e29-b81a-5d1e53c06699 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011379 Jul 22 11:07:31.235722 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: [pid: 103398|app: 0|req: 23/47] 10.222.0.20 () {60 vars in 1190 bytes} [Fri Jul 22 11:07:31 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 22 11:07:32.187916 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi [None req-7a3f03a1-3d78-4470-a887-1333d21ee895 admin admin] Calling method '>' {{(pid=103399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:07:32.188916 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: INFO nova.api.openstack.requestlog [None req-7a3f03a1-3d78-4470-a887-1333d21ee895 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Jul 22 11:07:32.189313 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: [pid: 103399|app: 0|req: 25/48] 10.222.0.20 () {56 vars in 1074 bytes} [Fri Jul 22 11:07:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:07:32.703764 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi [None req-be1ef369-d185-4fe1-b957-010ff4604bd4 admin admin] Calling method '>' {{(pid=103398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:07:32.709424 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: INFO nova.api.openstack.wsgi [None req-be1ef369-d185-4fe1-b957-010ff4604bd4 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 22 11:07:32.710915 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi [None req-be1ef369-d185-4fe1-b957-010ff4604bd4 admin admin] Request method failure captured: Jul 22 11:07:32.710915 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 22 11:07:32.710915 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: Accept: application/json Jul 22 11:07:32.710915 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: Accept-Encoding: gzip, deflate Jul 22 11:07:32.710915 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: Connection: keep-alive Jul 22 11:07:32.710915 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: Content-Length: 0 Jul 22 11:07:32.710915 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: Host: 10.222.0.20 Jul 22 11:07:32.710915 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: Openstack-Api-Version: compute 2.90 Jul 22 11:07:32.710915 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: Openstack-System-Scope: None Jul 22 11:07:32.710915 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: User-Agent: python-novaclient Jul 22 11:07:32.710915 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: X-Auth-Token: gAAAAABi2oT0g5g_a0NXf5DYMOHnlsOutkHD67tN9bDEchJHVEkRt0McMYOEQ7AYqlIk93aPX0qZqPTnVoG-l9b1UpoF3PGBoQ1BHiV3PxCiRnSuDx3H2s_xlsigGi87fCS9KSNWqPiPkzyn-D2lJO_7ckvRz0BBGi78IX-FQLjEW5g2i3OUpcw Jul 22 11:07:32.710915 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: X-Domain-Id: None Jul 22 11:07:32.710915 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: X-Domain-Name: None Jul 22 11:07:32.710915 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: X-Identity-Status: Confirmed Jul 22 11:07:32.710915 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: X-Is-Admin-Project: True Jul 22 11:07:32.710915 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: X-Openstack-Nova-Api-Version: 2.90 Jul 22 11:07:32.710915 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: X-Project-Domain-Id: default Jul 22 11:07:32.710915 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: X-Project-Domain-Name: Default Jul 22 11:07:32.710915 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: X-Project-Id: a25f160b71984d6fbacad5d6c1f3248c Jul 22 11:07:32.710915 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: X-Project-Name: admin Jul 22 11:07:32.710915 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: X-Role: reader,member,admin Jul 22 11:07:32.710915 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: X-Roles: reader,member,admin Jul 22 11:07:32.712593 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a25f160b71984d6fbacad5d6c1f3248c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a25f160b71984d6fbacad5d6c1f3248c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a25f160b71984d6fbacad5d6c1f3248c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a25f160b71984d6fbacad5d6c1f3248c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jul 22 11:07:32.712593 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: X-Tenant: admin Jul 22 11:07:32.712593 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: X-Tenant-Id: a25f160b71984d6fbacad5d6c1f3248c Jul 22 11:07:32.712593 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: X-Tenant-Name: admin Jul 22 11:07:32.712593 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: X-User: admin Jul 22 11:07:32.712593 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: X-User-Domain-Id: default Jul 22 11:07:32.712593 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: X-User-Domain-Name: Default Jul 22 11:07:32.712593 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: X-User-Id: 9a8c4f38edad4724ac733753692dda22 Jul 22 11:07:32.712593 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: X-User-Name: admin Jul 22 11:07:32.712593 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: method: > Jul 22 11:07:32.712593 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: exception: Flavor 451 could not be found. Jul 22 11:07:32.712593 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: action_args: {'id': '451'} Jul 22 11:07:32.712593 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: {{(pid=103398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 22 11:07:32.712593 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:07:32.713563 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 22 11:07:32.713563 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 22 11:07:32.713563 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 22 11:07:32.713563 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 22 11:07:32.713563 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 22 11:07:32.713563 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 22 11:07:32.713563 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 22 11:07:32.713563 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 22 11:07:32.713563 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 22 11:07:32.713563 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 22 11:07:32.713563 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 22 11:07:32.713563 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 22 11:07:32.713563 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 22 11:07:32.713563 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi Jul 22 11:07:32.713563 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:07:32.713563 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi Jul 22 11:07:32.713563 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:07:32.713563 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:07:32.713563 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:07:32.715812 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 22 11:07:32.715812 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 22 11:07:32.715812 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 22 11:07:32.715812 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 22 11:07:32.715812 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 22 11:07:32.715812 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 22 11:07:32.715812 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 22 11:07:32.715812 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi Jul 22 11:07:32.715812 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:07:32.715812 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi Jul 22 11:07:32.715812 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:07:32.715812 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:07:32.715812 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:07:32.715812 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 22 11:07:32.715812 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 22 11:07:32.715812 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 22 11:07:32.715812 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: ERROR nova.api.openstack.wsgi Jul 22 11:07:32.715812 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi [None req-be1ef369-d185-4fe1-b957-010ff4604bd4 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103398) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 22 11:07:32.717055 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: INFO nova.api.openstack.requestlog [None req-be1ef369-d185-4fe1-b957-010ff4604bd4 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.387774 Jul 22 11:07:32.717055 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: [pid: 103398|app: 0|req: 24/49] 10.222.0.20 () {60 vars in 1193 bytes} [Fri Jul 22 11:07:32 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 389 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 22 11:07:32.722348 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi [None req-20a46d3b-1d4c-4287-8d10-16b5a273cbaf admin admin] Calling method '>' {{(pid=103399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:07:32.735663 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: INFO nova.api.openstack.requestlog [None req-20a46d3b-1d4c-4287-8d10-16b5a273cbaf admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016852 Jul 22 11:07:32.736424 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: [pid: 103399|app: 0|req: 26/50] 10.222.0.20 () {60 vars in 1210 bytes} [Fri Jul 22 11:07:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:07:32.745470 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi [None req-ea0bb090-c0a4-4085-ad9f-8c510d0e5c11 admin admin] Calling method '>' {{(pid=103398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:07:32.759970 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: INFO nova.api.openstack.requestlog [None req-ea0bb090-c0a4-4085-ad9f-8c510d0e5c11 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017920 Jul 22 11:07:32.760496 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: [pid: 103398|app: 0|req: 25/51] 10.222.0.20 () {60 vars in 1210 bytes} [Fri Jul 22 11:07:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:07:32.769764 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi [None req-9a2fe531-55bd-4af2-8658-8efcbf0a52dd admin admin] Calling method '>' {{(pid=103399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:07:32.774882 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: INFO nova.api.openstack.wsgi [None req-9a2fe531-55bd-4af2-8658-8efcbf0a52dd admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 22 11:07:32.777103 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi [None req-9a2fe531-55bd-4af2-8658-8efcbf0a52dd admin admin] Request method failure captured: Jul 22 11:07:32.777103 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 22 11:07:32.777103 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: Accept: application/json Jul 22 11:07:32.777103 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: Accept-Encoding: gzip, deflate Jul 22 11:07:32.777103 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: Connection: keep-alive Jul 22 11:07:32.777103 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: Content-Length: 0 Jul 22 11:07:32.777103 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: Host: 10.222.0.20 Jul 22 11:07:32.777103 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: Openstack-Api-Version: compute 2.90 Jul 22 11:07:32.777103 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: Openstack-System-Scope: None Jul 22 11:07:32.777103 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: User-Agent: python-novaclient Jul 22 11:07:32.777103 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: X-Auth-Token: gAAAAABi2oT0g5g_a0NXf5DYMOHnlsOutkHD67tN9bDEchJHVEkRt0McMYOEQ7AYqlIk93aPX0qZqPTnVoG-l9b1UpoF3PGBoQ1BHiV3PxCiRnSuDx3H2s_xlsigGi87fCS9KSNWqPiPkzyn-D2lJO_7ckvRz0BBGi78IX-FQLjEW5g2i3OUpcw Jul 22 11:07:32.777103 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: X-Domain-Id: None Jul 22 11:07:32.777103 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: X-Domain-Name: None Jul 22 11:07:32.777103 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: X-Identity-Status: Confirmed Jul 22 11:07:32.777103 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: X-Is-Admin-Project: True Jul 22 11:07:32.777103 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: X-Openstack-Nova-Api-Version: 2.90 Jul 22 11:07:32.777103 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: X-Project-Domain-Id: default Jul 22 11:07:32.777103 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: X-Project-Domain-Name: Default Jul 22 11:07:32.777103 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: X-Project-Id: a25f160b71984d6fbacad5d6c1f3248c Jul 22 11:07:32.777103 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: X-Project-Name: admin Jul 22 11:07:32.777103 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: X-Role: reader,member,admin Jul 22 11:07:32.777103 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: X-Roles: reader,member,admin Jul 22 11:07:32.778647 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a25f160b71984d6fbacad5d6c1f3248c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a25f160b71984d6fbacad5d6c1f3248c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a25f160b71984d6fbacad5d6c1f3248c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a25f160b71984d6fbacad5d6c1f3248c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jul 22 11:07:32.778647 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: X-Tenant: admin Jul 22 11:07:32.778647 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: X-Tenant-Id: a25f160b71984d6fbacad5d6c1f3248c Jul 22 11:07:32.778647 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: X-Tenant-Name: admin Jul 22 11:07:32.778647 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: X-User: admin Jul 22 11:07:32.778647 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: X-User-Domain-Id: default Jul 22 11:07:32.778647 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: X-User-Domain-Name: Default Jul 22 11:07:32.778647 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: X-User-Id: 9a8c4f38edad4724ac733753692dda22 Jul 22 11:07:32.778647 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: X-User-Name: admin Jul 22 11:07:32.778647 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: method: > Jul 22 11:07:32.778647 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: exception: Flavor 451 could not be found. Jul 22 11:07:32.778647 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: action_args: {'id': '451'} Jul 22 11:07:32.778647 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: {{(pid=103399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 22 11:07:32.778647 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:07:32.779715 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 22 11:07:32.779715 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 22 11:07:32.779715 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 22 11:07:32.779715 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 22 11:07:32.779715 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 22 11:07:32.779715 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 22 11:07:32.779715 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 22 11:07:32.779715 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 22 11:07:32.779715 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 22 11:07:32.779715 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 22 11:07:32.779715 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 22 11:07:32.779715 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 22 11:07:32.779715 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 22 11:07:32.779715 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi Jul 22 11:07:32.779715 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:07:32.779715 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi Jul 22 11:07:32.779715 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:07:32.779715 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:07:32.779715 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:07:32.780782 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 22 11:07:32.780782 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 22 11:07:32.780782 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 22 11:07:32.780782 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 22 11:07:32.780782 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 22 11:07:32.780782 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 22 11:07:32.780782 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 22 11:07:32.780782 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi Jul 22 11:07:32.780782 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:07:32.780782 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi Jul 22 11:07:32.780782 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:07:32.780782 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:07:32.780782 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:07:32.780782 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 22 11:07:32.780782 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 22 11:07:32.780782 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 22 11:07:32.780782 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: ERROR nova.api.openstack.wsgi Jul 22 11:07:32.780782 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi [None req-9a2fe531-55bd-4af2-8658-8efcbf0a52dd admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 22 11:07:32.781825 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: INFO nova.api.openstack.requestlog [None req-9a2fe531-55bd-4af2-8658-8efcbf0a52dd admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012056 Jul 22 11:07:32.781825 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: [pid: 103399|app: 0|req: 27/52] 10.222.0.20 () {60 vars in 1193 bytes} [Fri Jul 22 11:07:32 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 22 11:07:33.737355 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi [None req-ea0bb090-c0a4-4085-ad9f-8c510d0e5c11 admin admin] Calling method '>' {{(pid=103398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:07:33.738418 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: INFO nova.api.openstack.requestlog [None req-ea0bb090-c0a4-4085-ad9f-8c510d0e5c11 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Jul 22 11:07:33.738807 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: [pid: 103398|app: 0|req: 26/53] 10.222.0.20 () {56 vars in 1074 bytes} [Fri Jul 22 11:07:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:07:34.259854 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi [None req-777f7a8f-413a-420d-bc7e-06f7ceeca7e6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:07:34.278343 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: INFO nova.api.openstack.requestlog [None req-777f7a8f-413a-420d-bc7e-06f7ceeca7e6 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.400762 Jul 22 11:07:34.278807 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: [pid: 103399|app: 0|req: 28/54] 10.222.0.20 () {64 vars in 1235 bytes} [Fri Jul 22 11:07:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 22 11:07:35.233343 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi [None req-ea0bb090-c0a4-4085-ad9f-8c510d0e5c11 admin admin] Calling method '>' {{(pid=103398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:07:35.234366 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: INFO nova.api.openstack.requestlog [None req-ea0bb090-c0a4-4085-ad9f-8c510d0e5c11 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Jul 22 11:07:35.234750 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: [pid: 103398|app: 0|req: 27/55] 10.222.0.20 () {56 vars in 1074 bytes} [Fri Jul 22 11:07:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:07:35.748983 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi [None req-58551c96-aac0-40f2-b3db-5b7255c1e0b4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:07:35.766385 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: INFO nova.api.openstack.requestlog [None req-58551c96-aac0-40f2-b3db-5b7255c1e0b4 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.395333 Jul 22 11:07:35.766913 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: [pid: 103399|app: 0|req: 29/56] 10.222.0.20 () {64 vars in 1235 bytes} [Fri Jul 22 11:07:35 2022] POST /compute/v2.1/flavors => generated 405 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 22 11:07:36.744857 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi [None req-ea0bb090-c0a4-4085-ad9f-8c510d0e5c11 admin admin] Calling method '>' {{(pid=103398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:07:36.746364 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: INFO nova.api.openstack.requestlog [None req-ea0bb090-c0a4-4085-ad9f-8c510d0e5c11 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001959 Jul 22 11:07:36.746752 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: [pid: 103398|app: 0|req: 28/57] 10.222.0.20 () {56 vars in 1074 bytes} [Fri Jul 22 11:07:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:07:37.268680 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi [None req-bd2a40a8-4417-4767-ade9-f14197ccb40f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:07:37.285418 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: INFO nova.api.openstack.requestlog [None req-bd2a40a8-4417-4767-ade9-f14197ccb40f admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.403049 Jul 22 11:07:37.285956 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: [pid: 103399|app: 0|req: 30/58] 10.222.0.20 () {64 vars in 1235 bytes} [Fri Jul 22 11:07:36 2022] POST /compute/v2.1/flavors => generated 407 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 22 11:07:38.255181 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi [None req-ea0bb090-c0a4-4085-ad9f-8c510d0e5c11 admin admin] Calling method '>' {{(pid=103398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:07:38.256219 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: INFO nova.api.openstack.requestlog [None req-ea0bb090-c0a4-4085-ad9f-8c510d0e5c11 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Jul 22 11:07:38.256617 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: [pid: 103398|app: 0|req: 29/59] 10.222.0.20 () {56 vars in 1074 bytes} [Fri Jul 22 11:07:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:07:38.785609 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi [None req-b28fa64f-2fb9-4aa7-9409-908e9a11bb49 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:07:38.804781 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: INFO nova.api.openstack.requestlog [None req-b28fa64f-2fb9-4aa7-9409-908e9a11bb49 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.411077 Jul 22 11:07:38.805317 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: [pid: 103399|app: 0|req: 31/60] 10.222.0.20 () {64 vars in 1235 bytes} [Fri Jul 22 11:07:38 2022] POST /compute/v2.1/flavors => generated 409 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 22 11:07:39.827096 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi [None req-ea0bb090-c0a4-4085-ad9f-8c510d0e5c11 admin admin] Calling method '>' {{(pid=103398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:07:39.828460 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: INFO nova.api.openstack.requestlog [None req-ea0bb090-c0a4-4085-ad9f-8c510d0e5c11 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001770 Jul 22 11:07:39.828849 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: [pid: 103398|app: 0|req: 30/61] 10.222.0.20 () {56 vars in 1074 bytes} [Fri Jul 22 11:07:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:07:40.351621 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi [None req-10cbb31a-39fe-4b83-80c0-4f319097ea60 admin admin] Calling method '>' {{(pid=103399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:07:40.374976 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: INFO nova.api.openstack.requestlog [None req-10cbb31a-39fe-4b83-80c0-4f319097ea60 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.408540 Jul 22 11:07:40.375535 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: [pid: 103399|app: 0|req: 32/62] 10.222.0.20 () {60 vars in 1202 bytes} [Fri Jul 22 11:07:39 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:08:32.061409 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi [None req-ea0bb090-c0a4-4085-ad9f-8c510d0e5c11 admin admin] Calling method '>' {{(pid=103398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:08:32.062410 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: INFO nova.api.openstack.requestlog [None req-ea0bb090-c0a4-4085-ad9f-8c510d0e5c11 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Jul 22 11:08:32.062802 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: [pid: 103398|app: 0|req: 31/63] 10.222.0.20 () {54 vars in 930 bytes} [Fri Jul 22 11:08:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:08:32.073266 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG dbcounter [-] [103399] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:08:32.449650 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi [None req-51a31cfe-580b-42be-aafa-e2db1bc7cc52 admin admin] Calling method '>' {{(pid=103399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:08:32.468895 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: INFO nova.api.openstack.requestlog [None req-51a31cfe-580b-42be-aafa-e2db1bc7cc52 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.400107 Jul 22 11:08:32.469427 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: [pid: 103399|app: 0|req: 33/64] 10.222.0.20 () {60 vars in 1291 bytes} [Fri Jul 22 11:08:32 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:08:32.493636 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi [None req-5fe240e2-e4b5-4280-be2f-17ec4770e174 admin admin] Calling method '>' {{(pid=103398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:08:32.497019 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG dbcounter [-] [103398] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:08:32.502200 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: INFO nova.api.openstack.requestlog [None req-5fe240e2-e4b5-4280-be2f-17ec4770e174 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012309 Jul 22 11:08:32.502719 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: [pid: 103398|app: 0|req: 32/65] 10.222.0.20 () {60 vars in 1282 bytes} [Fri Jul 22 11:08:32 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:08:32.514138 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi [None req-3dda5a05-7291-44c1-a8b1-ef7bbf231607 admin admin] Calling method '>' {{(pid=103399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:08:32.521730 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: INFO nova.api.openstack.requestlog [None req-3dda5a05-7291-44c1-a8b1-ef7bbf231607 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011131 Jul 22 11:08:32.522250 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: [pid: 103399|app: 0|req: 34/66] 10.222.0.20 () {60 vars in 1285 bytes} [Fri Jul 22 11:08:32 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:08:32.533865 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi [None req-1d6f8cf4-1f8f-45e9-af3b-a45e492ae758 admin admin] Calling method '>' {{(pid=103398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:08:32.542029 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: INFO nova.api.openstack.requestlog [None req-1d6f8cf4-1f8f-45e9-af3b-a45e492ae758 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011640 Jul 22 11:08:32.542548 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: [pid: 103398|app: 0|req: 33/67] 10.222.0.20 () {60 vars in 1285 bytes} [Fri Jul 22 11:08:32 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:08:32.553556 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi [None req-3ef44ff7-376b-4685-bc6d-f28ebe23a28e admin admin] Calling method '>' {{(pid=103399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:08:32.561081 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: INFO nova.api.openstack.requestlog [None req-3ef44ff7-376b-4685-bc6d-f28ebe23a28e admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010998 Jul 22 11:08:32.561594 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: [pid: 103399|app: 0|req: 35/68] 10.222.0.20 () {60 vars in 1282 bytes} [Fri Jul 22 11:08:32 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:11:52.916369 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi [None req-1d6f8cf4-1f8f-45e9-af3b-a45e492ae758 admin admin] Calling method '>' {{(pid=103398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:11:52.918091 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: INFO nova.api.openstack.requestlog [None req-1d6f8cf4-1f8f-45e9-af3b-a45e492ae758 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002438 Jul 22 11:11:52.918746 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: [pid: 103398|app: 0|req: 34/69] 10.222.0.20 () {56 vars in 1074 bytes} [Fri Jul 22 11:11:52 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:11:53.071286 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG dbcounter [-] [103399] Writing DB stats nova_api:SELECT=6 {{(pid=103399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:11:53.264166 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi [None req-0b20c74a-701d-4a16-8b71-a87fe32da9f5 admin admin] Calling method '>' {{(pid=103399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:11:53.265295 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 11:11:53.265295 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: warnings.warn(msg) Jul 22 11:11:53.266513 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG oslo_concurrency.lockutils [None req-0b20c74a-701d-4a16-8b71-a87fe32da9f5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:11:53.266955 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG oslo_concurrency.lockutils [None req-0b20c74a-701d-4a16-8b71-a87fe32da9f5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:11:53.267780 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG oslo_concurrency.lockutils [None req-0b20c74a-701d-4a16-8b71-a87fe32da9f5 admin admin] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:11:53.268201 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG oslo_concurrency.lockutils [None req-0b20c74a-701d-4a16-8b71-a87fe32da9f5 admin admin] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:11:53.303034 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: INFO nova.api.openstack.requestlog [None req-0b20c74a-701d-4a16-8b71-a87fe32da9f5 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.237347 Jul 22 11:11:53.303700 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: [pid: 103399|app: 0|req: 36/70] 10.222.0.20 () {60 vars in 1193 bytes} [Fri Jul 22 11:11:53 2022] GET /compute/v2.1/os-services => generated 791 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 22 11:11:54.196449 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi [None req-1d6f8cf4-1f8f-45e9-af3b-a45e492ae758 admin admin] Calling method '>' {{(pid=103398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:11:54.198048 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: INFO nova.api.openstack.requestlog [None req-1d6f8cf4-1f8f-45e9-af3b-a45e492ae758 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002238 Jul 22 11:11:54.198655 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: [pid: 103398|app: 0|req: 35/71] 10.222.0.20 () {56 vars in 1074 bytes} [Fri Jul 22 11:11:54 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:11:54.408514 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi [None req-cf7e3c7d-2b97-48e4-bb92-7887e242781c admin admin] Calling method '>' {{(pid=103399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:11:54.409690 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 11:11:54.409690 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: warnings.warn(msg) Jul 22 11:11:54.411537 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG oslo_concurrency.lockutils [None req-cf7e3c7d-2b97-48e4-bb92-7887e242781c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:11:54.411983 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG oslo_concurrency.lockutils [None req-cf7e3c7d-2b97-48e4-bb92-7887e242781c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:11:54.412793 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG oslo_concurrency.lockutils [None req-cf7e3c7d-2b97-48e4-bb92-7887e242781c admin admin] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:11:54.413221 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG oslo_concurrency.lockutils [None req-cf7e3c7d-2b97-48e4-bb92-7887e242781c admin admin] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:11:54.433254 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: INFO nova.api.openstack.requestlog [None req-cf7e3c7d-2b97-48e4-bb92-7887e242781c admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.085745 Jul 22 11:11:54.433826 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: [pid: 103399|app: 0|req: 37/72] 10.222.0.20 () {60 vars in 1193 bytes} [Fri Jul 22 11:11:54 2022] GET /compute/v2.1/os-services => generated 791 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 22 11:12:05.704318 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi [None req-1d6f8cf4-1f8f-45e9-af3b-a45e492ae758 admin admin] Calling method '>' {{(pid=103398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:12:05.705390 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: INFO nova.api.openstack.requestlog [None req-1d6f8cf4-1f8f-45e9-af3b-a45e492ae758 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Jul 22 11:12:05.705787 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: [pid: 103398|app: 0|req: 36/73] 10.222.0.20 () {56 vars in 1074 bytes} [Fri Jul 22 11:12:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:12:05.849064 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG dbcounter [-] [103399] Writing DB stats nova_cell0:SELECT=4 {{(pid=103399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:12:05.850154 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG dbcounter [-] [103399] Writing DB stats nova_cell1:SELECT=4 {{(pid=103399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:12:05.850766 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG dbcounter [-] [103399] Writing DB stats nova_api:SELECT=8 {{(pid=103399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:12:05.898427 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi [None req-3ec297c6-ea5d-4073-a1e7-c990433b613d admin admin] Calling method '>' {{(pid=103399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:12:05.899763 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 11:12:05.899763 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: warnings.warn(msg) Jul 22 11:12:05.900955 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG oslo_concurrency.lockutils [None req-3ec297c6-ea5d-4073-a1e7-c990433b613d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:12:05.901399 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG oslo_concurrency.lockutils [None req-3ec297c6-ea5d-4073-a1e7-c990433b613d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:12:05.902183 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG oslo_concurrency.lockutils [None req-3ec297c6-ea5d-4073-a1e7-c990433b613d admin admin] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:12:05.902612 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG oslo_concurrency.lockutils [None req-3ec297c6-ea5d-4073-a1e7-c990433b613d admin admin] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:12:05.928436 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: INFO nova.api.openstack.requestlog [None req-3ec297c6-ea5d-4073-a1e7-c990433b613d admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.084381 Jul 22 11:12:05.928995 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: [pid: 103399|app: 0|req: 38/74] 10.222.0.20 () {60 vars in 1193 bytes} [Fri Jul 22 11:12:05 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:12:06.777001 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: DEBUG nova.api.openstack.wsgi [None req-1d6f8cf4-1f8f-45e9-af3b-a45e492ae758 admin admin] Calling method '>' {{(pid=103398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:12:06.778005 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: INFO nova.api.openstack.requestlog [None req-1d6f8cf4-1f8f-45e9-af3b-a45e492ae758 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Jul 22 11:12:06.778404 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: [pid: 103398|app: 0|req: 37/75] 10.222.0.20 () {56 vars in 1074 bytes} [Fri Jul 22 11:12:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:12:06.971487 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG nova.api.openstack.wsgi [None req-317bfc93-0f5d-45a7-b145-8031f33cf9fe admin admin] Calling method '>' {{(pid=103399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:12:06.972695 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 11:12:06.972695 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: warnings.warn(msg) Jul 22 11:12:06.973891 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG oslo_concurrency.lockutils [None req-317bfc93-0f5d-45a7-b145-8031f33cf9fe admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:12:06.974341 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG oslo_concurrency.lockutils [None req-317bfc93-0f5d-45a7-b145-8031f33cf9fe admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:12:06.975128 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG oslo_concurrency.lockutils [None req-317bfc93-0f5d-45a7-b145-8031f33cf9fe admin admin] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:12:06.975615 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: DEBUG oslo_concurrency.lockutils [None req-317bfc93-0f5d-45a7-b145-8031f33cf9fe admin admin] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:12:06.997792 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: INFO nova.api.openstack.requestlog [None req-317bfc93-0f5d-45a7-b145-8031f33cf9fe admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.077602 Jul 22 11:12:06.998328 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: [pid: 103399|app: 0|req: 39/76] 10.222.0.20 () {60 vars in 1193 bytes} [Fri Jul 22 11:12:06 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:13:03.334393 dv-cinder-848900-4-iscsi devstack@n-api.service[103397]: Fri Jul 22 11:13:03 2022 - graceful shutdown triggered... Jul 22 11:13:03.334520 dv-cinder-848900-4-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 22 11:13:03.335508 dv-cinder-848900-4-iscsi devstack@n-api.service[103398]: Gracefully killing worker 1 (pid: 103398)... Jul 22 11:13:03.335898 dv-cinder-848900-4-iscsi devstack@n-api.service[103399]: Gracefully killing worker 2 (pid: 103399)... Jul 22 11:13:04.336630 dv-cinder-848900-4-iscsi devstack@n-api.service[103397]: worker 1 buried after 1 seconds Jul 22 11:13:04.337199 dv-cinder-848900-4-iscsi devstack@n-api.service[103397]: worker 2 buried after 1 seconds Jul 22 11:13:04.337199 dv-cinder-848900-4-iscsi devstack@n-api.service[103397]: goodbye to uWSGI. Jul 22 11:13:04.338199 dv-cinder-848900-4-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 22 11:13:04.338769 dv-cinder-848900-4-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 22 11:13:04.341567 dv-cinder-848900-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 22 11:13:04.350670 dv-cinder-848900-4-iscsi devstack@n-api.service[117867]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 22 11:13:04.352701 dv-cinder-848900-4-iscsi devstack@n-api.service[117867]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jul 22 11:13:04 2022] *** Jul 22 11:13:04.352701 dv-cinder-848900-4-iscsi devstack@n-api.service[117867]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 22 11:13:04.352701 dv-cinder-848900-4-iscsi devstack@n-api.service[117867]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 22 11:13:04.352701 dv-cinder-848900-4-iscsi devstack@n-api.service[117867]: nodename: dv-cinder-848900-4-iscsi Jul 22 11:13:04.352701 dv-cinder-848900-4-iscsi devstack@n-api.service[117867]: machine: x86_64 Jul 22 11:13:04.352701 dv-cinder-848900-4-iscsi devstack@n-api.service[117867]: clock source: unix Jul 22 11:13:04.352701 dv-cinder-848900-4-iscsi devstack@n-api.service[117867]: pcre jit disabled Jul 22 11:13:04.352701 dv-cinder-848900-4-iscsi devstack@n-api.service[117867]: detected number of CPU cores: 4 Jul 22 11:13:04.352701 dv-cinder-848900-4-iscsi devstack@n-api.service[117867]: current working directory: / Jul 22 11:13:04.352701 dv-cinder-848900-4-iscsi devstack@n-api.service[117867]: detected binary path: /usr/bin/uwsgi-core Jul 22 11:13:04.352701 dv-cinder-848900-4-iscsi devstack@n-api.service[117867]: your processes number limit is 47680 Jul 22 11:13:04.353425 dv-cinder-848900-4-iscsi devstack@n-api.service[117867]: your memory page size is 4096 bytes Jul 22 11:13:04.353425 dv-cinder-848900-4-iscsi devstack@n-api.service[117867]: detected max file descriptor number: 2048 Jul 22 11:13:04.353425 dv-cinder-848900-4-iscsi devstack@n-api.service[117867]: lock engine: pthread robust mutexes Jul 22 11:13:04.353425 dv-cinder-848900-4-iscsi devstack@n-api.service[117867]: thunder lock: enabled Jul 22 11:13:04.353425 dv-cinder-848900-4-iscsi devstack@n-api.service[117867]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 22 11:13:04.353425 dv-cinder-848900-4-iscsi devstack@n-api.service[117867]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 22 11:13:04.397979 dv-cinder-848900-4-iscsi devstack@n-api.service[117867]: Python main interpreter initialized at 0x560dd00169c0 Jul 22 11:13:04.397979 dv-cinder-848900-4-iscsi devstack@n-api.service[117867]: python threads support enabled Jul 22 11:13:04.397979 dv-cinder-848900-4-iscsi devstack@n-api.service[117867]: your server socket listen backlog is limited to 100 connections Jul 22 11:13:04.397979 dv-cinder-848900-4-iscsi devstack@n-api.service[117867]: your mercy for graceful operations on workers is 90 seconds Jul 22 11:13:04.398432 dv-cinder-848900-4-iscsi devstack@n-api.service[117867]: mapped 403077 bytes (393 KB) for 2 cores Jul 22 11:13:04.398534 dv-cinder-848900-4-iscsi devstack@n-api.service[117867]: *** Operational MODE: preforking *** Jul 22 11:13:04.398764 dv-cinder-848900-4-iscsi devstack@n-api.service[117867]: *** uWSGI is running in multiple interpreter mode *** Jul 22 11:13:04.398764 dv-cinder-848900-4-iscsi devstack@n-api.service[117867]: spawned uWSGI master process (pid: 117867) Jul 22 11:13:04.398979 dv-cinder-848900-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 22 11:13:04.399598 dv-cinder-848900-4-iscsi devstack@n-api.service[117867]: spawned uWSGI worker 1 (pid: 117884, cores: 1) Jul 22 11:13:04.400758 dv-cinder-848900-4-iscsi devstack@n-api.service[117867]: spawned uWSGI worker 2 (pid: 117885, cores: 1) Jul 22 11:13:04.400758 dv-cinder-848900-4-iscsi devstack@n-api.service[117867]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 22 11:13:05.059818 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 22 11:13:05.073387 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 22 11:13:06.267992 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 22 11:13:06.267992 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: from cryptography.utils import int_from_bytes Jul 22 11:13:06.268655 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 22 11:13:06.268655 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: from cryptography.utils import int_from_bytes Jul 22 11:13:06.289219 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 22 11:13:06.289219 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: from cryptography.utils import int_from_bytes Jul 22 11:13:06.289803 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 22 11:13:06.289803 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: from cryptography.utils import int_from_bytes Jul 22 11:13:08.603156 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 22 11:13:08.603597 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 22 11:13:08.603982 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 22 11:13:08.604452 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 22 11:13:08.604849 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 22 11:13:08.605255 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.605592 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.605917 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.606242 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.606767 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.607241 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.607760 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.608432 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.608802 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.609055 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.609556 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.609893 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-848900-4-iscsi {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.610308 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.610647 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.610966 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.611319 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.611638 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.611968 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.612282 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.612796 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.613531 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.614359 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.614853 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.615192 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.615546 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.615859 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.616365 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.616844 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 22 11:13:08.617280 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.617358 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 22 11:13:08.617441 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.617523 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.617603 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 22 11:13:08.617902 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-848900-4-iscsi {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.618019 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 22 11:13:08.618186 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 22 11:13:08.618340 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.618515 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.618835 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.619014 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.619298 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.619525 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.619659 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.619845 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.619973 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.620224 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.620418 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.620549 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.620850 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.621009 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.621184 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.621474 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.621574 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.621800 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.621907 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.622123 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.622229 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.622428 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.622546 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.622701 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.622814 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.623039 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.623281 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.623402 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.623616 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-848900-4-iscsi {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.623904 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.624097 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.624214 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.624357 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.624547 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.624761 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.624860 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.625083 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.625183 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.625409 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.625515 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.625765 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.625934 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.626163 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.626351 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.626543 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.626800 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.626953 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.627109 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.627253 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.627428 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.627582 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.627743 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.627899 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.628052 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.628202 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.628363 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.628516 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.628659 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.628802 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.628951 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.629100 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.629260 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.629925 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.630069 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.630236 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.630236 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.630533 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-848900-4-iscsi {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.630685 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.630849 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.630849 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.631130 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.631323 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.631475 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.631475 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.631786 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.631939 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.632089 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.632232 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.632384 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.632384 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.633584 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.633752 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.633898 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.634050 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.634213 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.634358 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.634509 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.634661 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.634804 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.634946 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.635103 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.635312 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.635475 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.635475 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.635839 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.635990 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.636150 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.636302 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.636445 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.636588 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.636731 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.636873 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.637029 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.637175 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.637317 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.637459 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.637620 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.637774 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.637918 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.638061 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.638212 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.638366 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.638520 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.638678 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.638825 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.638968 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.639118 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.639307 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.639483 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.639638 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.639795 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.639938 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.640092 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.640236 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.640394 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.640538 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.640681 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.640834 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.640986 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.641138 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.641306 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.641452 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.641607 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.641759 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.641911 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.642063 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.642221 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.642373 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.642525 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.642679 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.642679 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.644187 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.644339 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.644498 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.644654 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.644799 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.644993 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.645657 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.645904 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.646054 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.646197 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.646352 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.646497 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.646648 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.646806 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.646962 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.647183 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.647366 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.647521 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.647667 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.647810 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.647960 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.648116 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.648266 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.648459 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.648622 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.648769 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.648912 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.649081 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.649233 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.649387 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.649539 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.649688 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.649842 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.649986 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.650136 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.650290 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.650441 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.650591 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.650744 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.650889 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.651050 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.651194 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.651422 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.651578 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.651732 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.651877 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.652027 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.652178 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.652322 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.652473 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.652626 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.652771 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.653092 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.654311 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.654477 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.654623 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.654767 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.654919 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.655077 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.655230 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.655414 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.655566 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.655710 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.655853 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.656126 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.656273 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.656442 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.656595 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.656739 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.656892 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.657050 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.657198 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.657349 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.657518 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.658200 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.658370 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.658370 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.658658 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.658818 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.658964 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.659114 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.659286 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.659448 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.659600 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.659752 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.659903 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.660054 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.660205 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.660477 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.660477 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.660477 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.660959 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.661109 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.661252 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.661395 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.661562 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.661714 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.661859 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.662012 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.662164 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.662309 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.662470 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.662633 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.662788 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.662931 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.662931 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.663815 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.663978 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.664132 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.664390 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.664699 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.664850 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.665001 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.665154 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.665300 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.665455 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.665600 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.665750 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.665902 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.666147 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.666307 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.666460 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.666612 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.666757 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.666914 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.667058 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.667209 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.667388 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.667388 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.667664 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.667811 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 11:13:08.667974 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.667974 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.668264 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.668408 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.668557 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.668709 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.668820 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.668908 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.669040 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.669159 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.669254 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.669347 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.669451 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.669545 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.669637 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.669723 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.669806 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.669889 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.669980 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.670073 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.670206 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.670301 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.670386 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.670478 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.670571 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.670663 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.670748 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.670837 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.670921 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.671017 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.671141 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.671275 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.671413 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.671551 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.671640 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.671733 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.671733 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.671895 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.671987 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.672078 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.672078 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.672252 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.672252 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.672414 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.672498 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.672590 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.672752 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.672846 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.672926 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.673011 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.673141 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.673464 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.673730 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.673829 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.673916 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.674007 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.674099 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.674190 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.674285 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.674403 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.674498 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.674584 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.674685 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.674771 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.674866 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.674958 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.675051 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.675250 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.675433 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.675544 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.675639 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.675731 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.675823 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.675907 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.675991 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.676082 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.676264 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.676360 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.676500 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.676590 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.676682 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.676775 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.676867 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.676952 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.677043 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.677134 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.677227 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.677320 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.677406 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.677496 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.677581 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.677671 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.677765 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.677851 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.677941 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.678033 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.678118 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.678211 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.678305 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.678390 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.678474 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.678556 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.678646 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.678730 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.678822 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.678907 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.679005 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.679091 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.679232 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.679389 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.679587 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.679687 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.679895 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.679994 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.680207 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.680298 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.680514 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.680613 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.680820 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.680919 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.681128 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.681229 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.681438 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.681541 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.681742 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.681840 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.682045 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.682143 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.682349 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.682448 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.682653 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.682798 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.682956 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.683097 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.683295 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.683587 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.683810 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.683941 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.684086 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.684231 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.684363 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.684452 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.684544 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.684637 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.684854 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.684953 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.685159 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.685265 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.685465 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.685568 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.685849 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.685941 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.686178 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.686320 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.686506 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.686822 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.687156 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.687355 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.687533 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.687702 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.687864 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.688017 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.688183 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.688336 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.688482 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.688626 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.688777 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.688960 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.689120 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.689272 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.689423 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.689566 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.689721 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.689874 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.690019 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.690319 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.690625 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.690935 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.691240 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.691571 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.691762 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.692461 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.693068 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.693257 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.693416 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.693729 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.693983 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.694156 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.694302 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.694445 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.694603 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.694858 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.695019 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.695192 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.695558 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.695788 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.695962 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.696132 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.696278 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.696429 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.696592 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.696758 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.696918 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.697112 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.697270 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.697426 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.697578 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.697731 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.697875 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.698062 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.698212 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.698385 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.698536 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.698700 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.698852 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.699022 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.699339 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.699496 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.699652 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.699808 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.699952 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.700103 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.700254 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.700397 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.700539 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.700691 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.700846 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.700999 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.701150 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.701302 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.701446 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.701670 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.701824 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.701967 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.702118 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.702264 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.702420 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.702565 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.702721 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.702884 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.703028 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.703179 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.703379 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.703570 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.703873 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.704116 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.704269 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.704414 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.704566 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.704719 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.704863 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.705018 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.705170 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.705322 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.705475 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.705475 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.705795 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.705950 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.706094 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.706251 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.706397 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.706548 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.706691 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.706841 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.707002 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.707155 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.707345 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.707558 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.708192 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.708336 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.708480 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.708637 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.708782 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.708925 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.709068 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.709211 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.709365 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.709532 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.709678 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.709828 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.709973 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.710116 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.710258 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.710415 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.710561 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.710711 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.710862 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.711013 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.711171 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.711332 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.711492 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.711650 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.711801 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.711946 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.712101 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.712246 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.712246 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.712518 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.712668 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.712819 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.712973 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.713124 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.713275 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.713435 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.713591 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.713742 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.714032 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.714268 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.714417 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.714561 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.714704 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.714858 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.714858 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.715140 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.715314 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.715475 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.715620 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.715786 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.715969 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.716118 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.716269 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.716421 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.716572 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.716731 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.716877 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.717020 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.717163 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.717306 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.717466 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.717626 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.717771 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.717923 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.718073 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.718222 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.718381 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.718532 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.718690 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.718847 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.718999 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.719149 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.719344 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.719344 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.719729 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.719892 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.720043 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.720201 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.720361 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.720512 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.720662 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.720819 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.720978 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.721147 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.721307 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.721473 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.721635 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.721794 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.721946 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.722110 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.722263 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.722421 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.722421 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.722732 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.722890 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.723076 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.723235 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.723429 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.723606 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.723766 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.723918 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.724225 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.724403 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.724554 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.724714 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.724714 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.725009 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.725160 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.725311 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.725467 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.725665 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.725841 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.725993 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.726152 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.726312 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.726312 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.726626 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.726785 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.726943 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.727095 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.727245 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.727434 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.727593 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.727751 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.727913 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.728074 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.728233 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.728395 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.728546 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.728695 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.728845 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.728995 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.729152 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.729312 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.729473 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.729632 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.729791 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.729969 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.730128 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.730279 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.730429 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.730580 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.730738 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.730890 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.731040 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.731040 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.731367 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.731523 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.731753 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.731925 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.732084 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.732236 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.732386 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.732536 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.732699 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.732858 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.733016 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.733173 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.733325 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.733487 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.733648 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.733799 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.733959 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.734255 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.734419 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.734579 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.734732 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.734889 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.735048 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.735225 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.735466 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.735631 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.735796 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.735955 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.736114 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.736280 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.736431 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.736590 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.736753 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.736906 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.737064 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.737222 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.737383 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.737536 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.737685 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.737837 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.737995 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.738163 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.738323 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.738482 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.738632 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.739086 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.739247 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.739425 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.739655 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.739809 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.739968 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.740120 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.740271 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.740421 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.740593 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.740593 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.740895 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.741046 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.741202 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.741362 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.741519 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.741519 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.741814 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.741963 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.741963 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.742261 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.742420 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.742582 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.742732 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.742882 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.743031 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.743191 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.743377 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.743541 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.743699 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.743857 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.744015 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.744322 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.744484 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.744643 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.744813 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.744972 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.745131 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.745290 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.745449 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.745600 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.745762 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.745914 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.746073 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.746233 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.746385 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.746534 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.746691 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.746853 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.747019 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.747171 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.747359 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.747530 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.747682 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.747833 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.747992 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.748151 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.748311 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.748462 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.748666 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.748788 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.748893 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.748985 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.749072 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.749159 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.749254 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.749357 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.749445 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.749537 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.749631 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.749631 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.749803 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.749898 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.749984 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.750069 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.750161 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.750254 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.750347 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.750441 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.750534 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.750620 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.750620 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.750850 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.750957 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.751044 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.751128 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.751212 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.751334 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.751432 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.751527 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.751620 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.751712 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.751799 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.751890 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.752013 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.752180 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.752329 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.752480 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.752643 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.752798 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.752959 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.753103 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.753267 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.753399 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.753571 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.753700 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.753897 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.753999 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.754254 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.754922 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.755122 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.755426 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.755621 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.755786 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.755938 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.756089 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.756240 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.756399 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.756563 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.756723 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.756874 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.757031 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.757188 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.757338 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.757514 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.757674 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.757827 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.757976 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.758127 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.758284 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.758444 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.758595 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.758745 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.758896 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.759053 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.759214 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.759424 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.759596 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.759747 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.759899 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.760059 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.760225 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.760378 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.760537 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.760688 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.760846 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.761005 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.761165 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.761325 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.761476 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.761637 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.761795 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.761955 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.762115 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.762274 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.762434 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.762593 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.762744 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.762907 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.763074 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.763232 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.763387 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.763495 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.763591 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.763692 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.763824 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.764074 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.764226 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.764390 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.764532 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.764708 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.765016 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.765191 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.765344 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.765495 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.765663 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.765824 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.765982 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.766143 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.766294 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.766459 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.766623 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.766782 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.766941 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.766941 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.767231 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.767431 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.767663 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.767836 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.767995 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.767995 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.768327 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.768327 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.768644 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.768796 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.768946 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.769095 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.769245 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.769396 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.769555 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.769708 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.769875 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.770574 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.770740 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.770908 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.770908 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.771203 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.771203 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.771549 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.771701 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.771863 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.772014 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.772173 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.772173 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.772478 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.772629 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.772794 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.772946 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.773103 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.773254 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.773404 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.773602 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.773772 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.773932 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.774090 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.774255 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.774416 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.774576 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.774728 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.774887 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.775175 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.775359 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.775514 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.775678 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.775830 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.775980 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.776130 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.776280 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.776437 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.776617 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.776771 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.776920 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.777071 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.777254 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.777421 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.777581 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.777741 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.777893 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.778043 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.778214 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.778373 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.778524 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.778825 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.778991 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.779144 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.779326 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.779498 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.779658 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.779820 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.779979 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.780140 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.780291 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.780441 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.780610 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.780776 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.780928 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.781086 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.781237 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.781387 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.781537 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.781687 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.781837 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.781998 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.782151 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.782320 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.782479 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.782637 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.782808 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.782969 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.782969 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.783299 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.783468 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.783621 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.783780 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.783932 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.784090 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.784241 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.784391 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.784541 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.784705 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.784867 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.785029 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.785302 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.785460 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.785648 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.785811 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.785971 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.785971 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.786296 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.786454 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.786605 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.786764 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.786924 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.787094 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.787271 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.787443 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.787609 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.787768 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.787926 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.788077 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.788264 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.788419 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.788419 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.788725 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.788957 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.789696 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.789865 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.790027 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.790195 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.790357 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.790516 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.790673 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.790824 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.790975 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.791213 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.791402 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.791556 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.791707 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.791871 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.791871 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.792182 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.792334 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.792484 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.792640 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.792640 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.792954 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.793106 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.793257 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.793408 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.793559 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.793715 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.793886 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.794038 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.794195 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.794345 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.794506 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.794656 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.794815 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.794966 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.795116 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.795354 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.795515 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.795680 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.795851 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.796009 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.796168 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.796319 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.796483 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.796645 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.796797 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.796956 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.796956 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.797250 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.797408 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.797573 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.797726 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.797726 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.797726 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.798174 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.798325 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.798485 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.798637 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.798796 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.798971 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.799194 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.799399 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.799563 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.799717 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.799867 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.800028 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.800187 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.800348 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.800513 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.800676 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.800829 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.800980 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.801137 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.801331 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.801484 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.801633 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.801783 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.801933 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.801933 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.802251 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.802402 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.802559 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.802717 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.802869 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.803032 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.803184 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.803367 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.803538 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.803696 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.803846 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.804021 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.804179 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.804339 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.804497 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.804655 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.804805 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.804968 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.805119 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.805268 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.805418 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.805568 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.805568 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.805870 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.806041 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.806199 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.806350 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.806498 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.806498 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.806805 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.806956 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.807106 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.807284 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.807442 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.807606 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.807765 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.807924 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.808087 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.808238 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.808395 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.808556 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.808707 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.808857 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.809008 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.809187 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.809417 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.809574 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.809725 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.809877 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.810038 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.810199 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.810360 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.810520 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.810684 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.810836 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.810988 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.811145 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.811354 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.811513 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.811664 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.811823 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.811990 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.812150 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.812310 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.812462 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.812614 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.812771 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.812923 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.813085 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.813237 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.813388 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.813545 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.813707 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.813867 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.814019 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.814176 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.814334 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.814486 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.814637 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.814799 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.814959 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.815117 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.815297 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.815455 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.815619 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.815795 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.815949 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.816100 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.816100 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.816385 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.816549 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.816701 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.817361 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.817525 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.817683 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.817835 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.817994 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.818164 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.818316 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.818467 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.818617 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.818617 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.818924 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.819076 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.819226 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.819429 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.819650 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.819816 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.819968 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.820124 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.820292 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.820450 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.820600 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.820829 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.820990 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.821152 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.821310 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.821460 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.821618 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.821784 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.821944 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.822094 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.822263 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.822413 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.822563 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.822722 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.822881 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.823031 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.823181 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.823353 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.823522 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.823674 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.823674 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.823961 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.824110 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.824272 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.824431 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.824583 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.824732 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.824882 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.825032 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.825183 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.825346 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.825498 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.825655 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.825814 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.825966 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.826123 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.826299 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.826451 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.826601 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.826759 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.826910 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.827070 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.827222 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.827449 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.827646 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.827757 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.827857 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.827962 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.828058 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.828152 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.828266 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.828350 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.828425 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.828522 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.828610 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.828691 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.828766 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.828908 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.829008 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.829099 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.829185 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.829261 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.829333 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.829404 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.829489 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.829570 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.829643 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.829721 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.829794 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.829873 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.829959 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.830034 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.830119 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.830199 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.830374 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.830466 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.830664 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.830761 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.830963 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.831045 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.831302 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.831416 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.831588 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.831691 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.831898 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.832000 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.832200 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.832303 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.833039 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.833138 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.833396 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.833690 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.833790 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.833995 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.834088 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.834304 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.834397 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.834659 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.834749 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.834978 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.835078 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.835303 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.835483 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.835639 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.835800 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.835975 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.836129 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.836288 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.836441 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.836592 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.836752 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.836912 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.837074 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.837233 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.837391 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.837543 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.837703 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.837856 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.838006 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.838250 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.838410 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.838586 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.838753 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.838905 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.839172 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.839398 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.839556 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.839706 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.839948 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.840116 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.840275 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.840426 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.840585 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.840746 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.840897 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.841047 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.841198 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.841348 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.841509 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.841671 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.841831 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.841831 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.842119 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.842270 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.842420 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.842579 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.842749 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.843328 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.843495 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.843662 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.843837 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.843998 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.844157 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.844316 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.844475 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.844626 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.844793 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.844946 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.844946 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.845240 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.845392 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.845542 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.845711 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.845875 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.846034 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.846187 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.846347 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.846508 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.846668 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.846820 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.846978 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.846978 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.846978 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.847468 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.847628 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.847791 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.847986 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.848177 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.848338 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.848503 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.848664 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.848823 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.848983 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.849169 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.849326 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.849553 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.849714 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.849881 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.850139 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.850312 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.850519 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.850679 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.850831 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.850989 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.851141 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.851310 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.851493 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.851648 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.851798 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.851959 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.852127 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.852298 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.852854 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.853024 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.853179 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.853338 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.853490 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.853649 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.853802 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.853953 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.854112 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.854265 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.854428 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.854595 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.854748 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.854900 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.855057 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.855057 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.855393 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.855561 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.855713 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.855875 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.856026 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.856176 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.856353 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.856513 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.856664 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.856815 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.856965 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.857116 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.857274 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.857435 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.857596 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.857747 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.857904 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.858063 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.858232 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.858396 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.858548 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.858698 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.858849 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.859007 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.859165 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.859361 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.859528 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.859681 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.859831 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.859995 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.860164 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.860385 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.860561 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.860713 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.860871 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.861037 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.861196 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.861355 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.861516 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.861676 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.861827 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.861987 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.862147 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.862314 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.862466 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.862635 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.862794 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.862964 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.863123 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.863293 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.863461 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.863614 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.864057 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.864214 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.864372 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.864529 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.864682 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.864840 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.865010 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.865170 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.865321 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.865471 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.865621 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.865785 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.866561 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.866729 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.866894 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.867055 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.867215 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.867405 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.867587 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.867740 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.867893 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.868044 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.868195 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.868360 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.868512 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.868669 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.868829 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.868982 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.869142 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.869308 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.869467 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.869630 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.869790 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.869949 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.870108 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.870268 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.870513 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.870679 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.870838 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.870999 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.871164 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.871333 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.871502 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.871674 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.871826 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.871976 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.872137 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.872298 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.872456 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.872607 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.872757 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.872908 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.873071 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.873223 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.873223 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.873528 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.873679 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.873838 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.873989 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.874147 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.874304 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.874468 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.874626 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.874787 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.874938 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.875094 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.875288 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.875448 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.875620 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.875788 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.875945 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.876104 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.876270 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.876422 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.876598 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.877165 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.877329 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.877490 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.877643 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.877802 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.877978 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.878132 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.878284 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.878436 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.878593 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.878745 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.878905 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.879058 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.879209 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.879909 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.880074 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.880074 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.880074 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 22 11:13:08.880553 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.880553 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.880553 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.880553 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.880553 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.880553 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.880553 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 11:13:08.880553 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 22 11:13:09.030486 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO dbcounter [None req-11f80b86-c54b-4b6b-8690-e0db2ac6c18c None None] Registered counter for database nova_api Jul 22 11:13:09.036638 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO dbcounter [None req-4d884ef7-f015-42b4-bbfc-2ea9be1ed1f5 None None] Registered counter for database nova_api Jul 22 11:13:09.050120 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_db.sqlalchemy.engines [None req-11f80b86-c54b-4b6b-8690-e0db2ac6c18c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117885) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 22 11:13:09.056484 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_db.sqlalchemy.engines [None req-4d884ef7-f015-42b4-bbfc-2ea9be1ed1f5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117884) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 22 11:13:09.057367 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writer thread running {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 22 11:13:09.062937 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG dbcounter [-] [117884] Writer thread running {{(pid=117884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 22 11:13:09.112722 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.context [None req-11f80b86-c54b-4b6b-8690-e0db2ac6c18c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5a7515c3-306c-4208-a5ca-3c2d18d91397(cell1) {{(pid=117885) load_cells /opt/stack/nova/nova/context.py:464}} Jul 22 11:13:09.117232 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-11f80b86-c54b-4b6b-8690-e0db2ac6c18c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:13:09.118811 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-11f80b86-c54b-4b6b-8690-e0db2ac6c18c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:13:09.119637 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-11f80b86-c54b-4b6b-8690-e0db2ac6c18c None None] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:13:09.120052 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.context [None req-4d884ef7-f015-42b4-bbfc-2ea9be1ed1f5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5a7515c3-306c-4208-a5ca-3c2d18d91397(cell1) {{(pid=117884) load_cells /opt/stack/nova/nova/context.py:464}} Jul 22 11:13:09.121588 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-11f80b86-c54b-4b6b-8690-e0db2ac6c18c None None] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:13:09.123566 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO dbcounter [None req-11f80b86-c54b-4b6b-8690-e0db2ac6c18c None None] Registered counter for database nova_cell0 Jul 22 11:13:09.124105 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-4d884ef7-f015-42b4-bbfc-2ea9be1ed1f5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:13:09.125995 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-4d884ef7-f015-42b4-bbfc-2ea9be1ed1f5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:13:09.126517 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-4d884ef7-f015-42b4-bbfc-2ea9be1ed1f5 None None] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:13:09.127648 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO dbcounter [None req-11f80b86-c54b-4b6b-8690-e0db2ac6c18c None None] Registered counter for database nova_cell1 Jul 22 11:13:09.128507 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-4d884ef7-f015-42b4-bbfc-2ea9be1ed1f5 None None] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:13:09.131027 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO dbcounter [None req-4d884ef7-f015-42b4-bbfc-2ea9be1ed1f5 None None] Registered counter for database nova_cell0 Jul 22 11:13:09.135140 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO dbcounter [None req-4d884ef7-f015-42b4-bbfc-2ea9be1ed1f5 None None] Registered counter for database nova_cell1 Jul 22 11:13:09.135721 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_db.sqlalchemy.engines [None req-11f80b86-c54b-4b6b-8690-e0db2ac6c18c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117885) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 22 11:13:09.137438 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_db.sqlalchemy.engines [None req-11f80b86-c54b-4b6b-8690-e0db2ac6c18c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117885) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 22 11:13:09.143764 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writer thread running {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 22 11:13:09.144169 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_db.sqlalchemy.engines [None req-4d884ef7-f015-42b4-bbfc-2ea9be1ed1f5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117884) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 22 11:13:09.145136 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_db.sqlalchemy.engines [None req-4d884ef7-f015-42b4-bbfc-2ea9be1ed1f5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117884) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 22 11:13:09.145348 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writer thread running {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 22 11:13:09.152008 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG dbcounter [-] [117884] Writer thread running {{(pid=117884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 22 11:13:09.153270 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG dbcounter [-] [117884] Writer thread running {{(pid=117884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 22 11:13:09.291023 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO dbcounter [None req-11f80b86-c54b-4b6b-8690-e0db2ac6c18c None None] Registered counter for database nova_cell0 Jul 22 11:13:09.298038 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_db.sqlalchemy.engines [None req-11f80b86-c54b-4b6b-8690-e0db2ac6c18c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117885) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 22 11:13:09.299200 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO dbcounter [None req-4d884ef7-f015-42b4-bbfc-2ea9be1ed1f5 None None] Registered counter for database nova_cell0 Jul 22 11:13:09.304997 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writer thread running {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 22 11:13:09.310639 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_db.sqlalchemy.engines [None req-4d884ef7-f015-42b4-bbfc-2ea9be1ed1f5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117884) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 22 11:13:09.317121 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG dbcounter [-] [117884] Writer thread running {{(pid=117884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 22 11:13:09.631805 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: WARNING keystonemiddleware.auth_token [None req-11f80b86-c54b-4b6b-8690-e0db2ac6c18c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 22 11:13:09.639220 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: WARNING keystonemiddleware.auth_token [None req-11f80b86-c54b-4b6b-8690-e0db2ac6c18c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 22 11:13:09.643969 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: WARNING keystonemiddleware.auth_token [None req-4d884ef7-f015-42b4-bbfc-2ea9be1ed1f5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 22 11:13:09.651355 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: WARNING keystonemiddleware.auth_token [None req-4d884ef7-f015-42b4-bbfc-2ea9be1ed1f5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 22 11:13:09.987556 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: WARNING keystonemiddleware.auth_token [None req-11f80b86-c54b-4b6b-8690-e0db2ac6c18c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 22 11:13:09.993866 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: WARNING keystonemiddleware.auth_token [None req-11f80b86-c54b-4b6b-8690-e0db2ac6c18c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 22 11:13:09.996513 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: WARNING keystonemiddleware.auth_token [None req-4d884ef7-f015-42b4-bbfc-2ea9be1ed1f5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 22 11:13:10.000191 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x560dd00169c0 pid: 117885 (default app) Jul 22 11:13:10.002528 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: WARNING keystonemiddleware.auth_token [None req-4d884ef7-f015-42b4-bbfc-2ea9be1ed1f5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 22 11:13:10.008764 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560dd00169c0 pid: 117884 (default app) Jul 22 11:13:51.007155 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_api:SELECT=3 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:13:51.008200 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell0:SELECT=3 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:13:51.009192 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=3 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:13:51.010064 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell0:SELECT=3 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:13:52.665325 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-79e5f738-5a87-4b4e-bce8-17cbe77f4bb6 tempest-VolumesSnapshotsTestJSON-386867167 tempest-VolumesSnapshotsTestJSON-386867167-project] Action: 'create', calling method: .version_select at 0x7f8447140ca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-784956102"}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:13:54.832532 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-79e5f738-5a87-4b4e-bce8-17cbe77f4bb6 tempest-VolumesSnapshotsTestJSON-386867167 tempest-VolumesSnapshotsTestJSON-386867167-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.836952 Jul 22 11:13:54.840401 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 1/1] 10.222.0.20 () {60 vars in 1154 bytes} [Fri Jul 22 11:13:50 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3840 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 22 11:13:54.849660 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG dbcounter [-] [117884] Writing DB stats nova_api:SELECT=3 {{(pid=117884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:13:54.850467 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG dbcounter [-] [117884] Writing DB stats nova_cell1:SELECT=3 {{(pid=117884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:13:54.851285 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG dbcounter [-] [117884] Writing DB stats nova_cell0:SELECT=3 {{(pid=117884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:13:54.852056 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG dbcounter [-] [117884] Writing DB stats nova_cell0:SELECT=3 {{(pid=117884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:13:55.486062 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-ef2b79cc-dc15-4430-a64c-7ebb1c13f209 tempest-VolumesSnapshotsTestJSON-386867167 tempest-VolumesSnapshotsTestJSON-386867167-project] Calling method '.version_select at 0x7f844718f790>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:13:56.146315 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-ef2b79cc-dc15-4430-a64c-7ebb1c13f209 tempest-VolumesSnapshotsTestJSON-386867167 tempest-VolumesSnapshotsTestJSON-386867167-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/32987e25-1c75-405f-b1e5-f152b4f38a7b" status: 200 len: 345 microversion: 2.1 time: 1.297592 Jul 22 11:13:56.146315 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 1/2] 10.222.0.20 () {58 vars in 1244 bytes} [Fri Jul 22 11:13:54 2022] GET /compute/v2.1/os-volumes/32987e25-1c75-405f-b1e5-f152b4f38a7b => generated 345 bytes in 1300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:13:56.170505 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-88737f15-3ee4-4141-97f9-960ea64b170c tempest-VolumesSnapshotsTestJSON-386867167 tempest-VolumesSnapshotsTestJSON-386867167-project] Action: 'create', calling method: .version_select at 0x7f844700ba60>, body: {"snapshot": {"volume_id": "32987e25-1c75-405f-b1e5-f152b4f38a7b", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-546803187"}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:13:56.654684 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-88737f15-3ee4-4141-97f9-960ea64b170c tempest-VolumesSnapshotsTestJSON-386867167 tempest-VolumesSnapshotsTestJSON-386867167-project] 10.222.0.20 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.500547 Jul 22 11:13:56.656884 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 2/3] 10.222.0.20 () {60 vars in 1161 bytes} [Fri Jul 22 11:13:56 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:13:56.668772 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-32f2a224-94b6-4448-b605-69645bec65b3 tempest-VolumesSnapshotsTestJSON-386867167 tempest-VolumesSnapshotsTestJSON-386867167-project] Calling method '.version_select at 0x7f8447054af0>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:13:56.742478 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-32f2a224-94b6-4448-b605-69645bec65b3 tempest-VolumesSnapshotsTestJSON-386867167 tempest-VolumesSnapshotsTestJSON-386867167-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/a81bae96-10d2-4e7a-baad-0ff0d61279ff" status: 200 len: 286 microversion: 2.1 time: 0.078685 Jul 22 11:13:56.745539 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 2/4] 10.222.0.20 () {58 vars in 1250 bytes} [Fri Jul 22 11:13:56 2022] GET /compute/v2.1/os-snapshots/a81bae96-10d2-4e7a-baad-0ff0d61279ff => generated 286 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:13:56.763228 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-264b288d-b538-4959-a20b-e70681d5e27d tempest-VolumesSnapshotsTestJSON-386867167 tempest-VolumesSnapshotsTestJSON-386867167-project] Calling method '.version_select at 0x7f844700bee0>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:13:56.929613 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-264b288d-b538-4959-a20b-e70681d5e27d tempest-VolumesSnapshotsTestJSON-386867167 tempest-VolumesSnapshotsTestJSON-386867167-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.173096 Jul 22 11:13:56.930822 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 3/5] 10.222.0.20 () {58 vars in 1139 bytes} [Fri Jul 22 11:13:56 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:13:56.943760 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-b44f4b01-45e3-4af8-9dee-fbf66b0892f7 tempest-VolumesSnapshotsTestJSON-386867167 tempest-VolumesSnapshotsTestJSON-386867167-project] Calling method '.version_select at 0x7f8447015280>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:13:57.071173 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-b44f4b01-45e3-4af8-9dee-fbf66b0892f7 tempest-VolumesSnapshotsTestJSON-386867167 tempest-VolumesSnapshotsTestJSON-386867167-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/a81bae96-10d2-4e7a-baad-0ff0d61279ff" status: 200 len: 286 microversion: 2.1 time: 0.132711 Jul 22 11:13:57.072251 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 3/6] 10.222.0.20 () {58 vars in 1250 bytes} [Fri Jul 22 11:13:56 2022] GET /compute/v2.1/os-snapshots/a81bae96-10d2-4e7a-baad-0ff0d61279ff => generated 286 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:13:58.084808 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-b4b2c032-a2bc-4197-b87b-771e740eecb4 tempest-VolumesSnapshotsTestJSON-386867167 tempest-VolumesSnapshotsTestJSON-386867167-project] Calling method '.version_select at 0x7f8447021820>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:13:58.150745 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-b4b2c032-a2bc-4197-b87b-771e740eecb4 tempest-VolumesSnapshotsTestJSON-386867167 tempest-VolumesSnapshotsTestJSON-386867167-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/a81bae96-10d2-4e7a-baad-0ff0d61279ff" status: 200 len: 286 microversion: 2.1 time: 0.070818 Jul 22 11:13:58.152153 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 4/7] 10.222.0.20 () {58 vars in 1250 bytes} [Fri Jul 22 11:13:58 2022] GET /compute/v2.1/os-snapshots/a81bae96-10d2-4e7a-baad-0ff0d61279ff => generated 286 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 22 11:13:59.164923 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-df23ec3e-bed3-416a-b284-a63a30eb678f tempest-VolumesSnapshotsTestJSON-386867167 tempest-VolumesSnapshotsTestJSON-386867167-project] Calling method '.version_select at 0x7f8447015940>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:13:59.242357 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-df23ec3e-bed3-416a-b284-a63a30eb678f tempest-VolumesSnapshotsTestJSON-386867167 tempest-VolumesSnapshotsTestJSON-386867167-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/a81bae96-10d2-4e7a-baad-0ff0d61279ff" status: 200 len: 286 microversion: 2.1 time: 0.082148 Jul 22 11:13:59.243649 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 4/8] 10.222.0.20 () {58 vars in 1250 bytes} [Fri Jul 22 11:13:59 2022] GET /compute/v2.1/os-snapshots/a81bae96-10d2-4e7a-baad-0ff0d61279ff => generated 286 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:14:00.256851 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-f18497e6-c35d-4607-8e0b-d3ee19aef830 tempest-VolumesSnapshotsTestJSON-386867167 tempest-VolumesSnapshotsTestJSON-386867167-project] Calling method '.version_select at 0x7f8447021f70>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:00.341457 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-f18497e6-c35d-4607-8e0b-d3ee19aef830 tempest-VolumesSnapshotsTestJSON-386867167 tempest-VolumesSnapshotsTestJSON-386867167-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/a81bae96-10d2-4e7a-baad-0ff0d61279ff" status: 200 len: 286 microversion: 2.1 time: 0.090684 Jul 22 11:14:00.342234 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 5/9] 10.222.0.20 () {58 vars in 1250 bytes} [Fri Jul 22 11:14:00 2022] GET /compute/v2.1/os-snapshots/a81bae96-10d2-4e7a-baad-0ff0d61279ff => generated 286 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 22 11:14:01.358888 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-e15465b0-3800-4943-9428-050e58493fa0 tempest-VolumesSnapshotsTestJSON-386867167 tempest-VolumesSnapshotsTestJSON-386867167-project] Calling method '.version_select at 0x7f8447054ca0>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:01.655517 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-e15465b0-3800-4943-9428-050e58493fa0 tempest-VolumesSnapshotsTestJSON-386867167 tempest-VolumesSnapshotsTestJSON-386867167-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/a81bae96-10d2-4e7a-baad-0ff0d61279ff" status: 200 len: 286 microversion: 2.1 time: 0.301171 Jul 22 11:14:01.656725 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 5/10] 10.222.0.20 () {58 vars in 1250 bytes} [Fri Jul 22 11:14:01 2022] GET /compute/v2.1/os-snapshots/a81bae96-10d2-4e7a-baad-0ff0d61279ff => generated 286 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:14:02.378448 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-f878a602-eae2-44de-806a-908d07409650 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Action: 'create', calling method: .version_select at 0x7f8447021d30>, body: {"keypair": {"name": "tempest-keypair-1251284060", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMs5c0nEKr59NCJ6a7KnMfu3sqySRzrt3re/owqARRGMYdnWuF2ChR2oUc9VOmUi+pFwpmv3a/32YcXTQM0xWw7KXbNRaWxh6yVMc0mJzWGuquTF3cw9HAJrDNSvxSk54Q=="}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:14:02.491997 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-f878a602-eae2-44de-806a-908d07409650 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Getting quotas for project 28836b7cb9c646aaaa1bb1c1fae68128. Resources: {'key_pairs'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 22 11:14:02.509965 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-f878a602-eae2-44de-806a-908d07409650 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Getting quotas for user 691877dce1024aeda61629073d74602b and project 28836b7cb9c646aaaa1bb1c1fae68128. Resources: {'key_pairs'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 22 11:14:02.672366 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-2d3dff4b-7d88-4f2e-a976-ac322686b2c1 tempest-VolumesSnapshotsTestJSON-386867167 tempest-VolumesSnapshotsTestJSON-386867167-project] Calling method '.version_select at 0x7f8447015af0>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:02.673671 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-f878a602-eae2-44de-806a-908d07409650 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.614197 Jul 22 11:14:02.684596 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 6/11] 10.222.0.20 () {60 vars in 1158 bytes} [Fri Jul 22 11:14:02 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:14:02.732376 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-2d3dff4b-7d88-4f2e-a976-ac322686b2c1 tempest-VolumesSnapshotsTestJSON-386867167 tempest-VolumesSnapshotsTestJSON-386867167-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/a81bae96-10d2-4e7a-baad-0ff0d61279ff" status: 200 len: 286 microversion: 2.1 time: 0.066197 Jul 22 11:14:02.734912 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 6/12] 10.222.0.20 () {58 vars in 1250 bytes} [Fri Jul 22 11:14:02 2022] GET /compute/v2.1/os-snapshots/a81bae96-10d2-4e7a-baad-0ff0d61279ff => generated 286 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 22 11:14:03.196684 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-f5e32a6a-a780-4e3d-9cd1-ed9d9cea0909 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1040522499", "imageRef": "1a6c3cb4-9f56-44c6-aa68-01000df27209", "flavorRef": "452", "networks": [{"uuid": "1a51435a-0afb-4925-9311-8d036dddb7a1"}]}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:14:03.336772 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.network.neutron [None req-f5e32a6a-a780-4e3d-9cd1-ed9d9cea0909 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] validate_networks() for [('1a51435a-0afb-4925-9311-8d036dddb7a1', None, None, None, None, None)] {{(pid=117885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 22 11:14:03.750115 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-8c58a077-4706-4c7e-9236-81c629d88168 tempest-VolumesSnapshotsTestJSON-386867167 tempest-VolumesSnapshotsTestJSON-386867167-project] Calling method '.version_select at 0x7f8447015310>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:03.864712 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-8c58a077-4706-4c7e-9236-81c629d88168 tempest-VolumesSnapshotsTestJSON-386867167 tempest-VolumesSnapshotsTestJSON-386867167-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/a81bae96-10d2-4e7a-baad-0ff0d61279ff" status: 200 len: 286 microversion: 2.1 time: 0.118220 Jul 22 11:14:03.865874 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 7/13] 10.222.0.20 () {58 vars in 1250 bytes} [Fri Jul 22 11:14:03 2022] GET /compute/v2.1/os-snapshots/a81bae96-10d2-4e7a-baad-0ff0d61279ff => generated 286 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:14:04.877337 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-41781124-8768-4446-b7b0-2162685f24ee tempest-VolumesSnapshotsTestJSON-386867167 tempest-VolumesSnapshotsTestJSON-386867167-project] Calling method '.version_select at 0x7f84470220d0>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:04.959948 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-41781124-8768-4446-b7b0-2162685f24ee tempest-VolumesSnapshotsTestJSON-386867167 tempest-VolumesSnapshotsTestJSON-386867167-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/a81bae96-10d2-4e7a-baad-0ff0d61279ff" status: 200 len: 287 microversion: 2.1 time: 0.086804 Jul 22 11:14:04.960507 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 8/14] 10.222.0.20 () {58 vars in 1250 bytes} [Fri Jul 22 11:14:04 2022] GET /compute/v2.1/os-snapshots/a81bae96-10d2-4e7a-baad-0ff0d61279ff => generated 287 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 22 11:14:04.972674 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-e0743d6b-73b5-4f7a-934e-c15e23da2f3f tempest-VolumesSnapshotsTestJSON-386867167 tempest-VolumesSnapshotsTestJSON-386867167-project] Calling method '.version_select at 0x7f84470150d0>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:05.159418 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-e0743d6b-73b5-4f7a-934e-c15e23da2f3f tempest-VolumesSnapshotsTestJSON-386867167 tempest-VolumesSnapshotsTestJSON-386867167-project] 10.222.0.20 "DELETE /compute/v2.1/os-snapshots/a81bae96-10d2-4e7a-baad-0ff0d61279ff" status: 202 len: 0 microversion: 2.1 time: 0.191138 Jul 22 11:14:05.160153 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 9/15] 10.222.0.20 () {58 vars in 1253 bytes} [Fri Jul 22 11:14:04 2022] DELETE /compute/v2.1/os-snapshots/a81bae96-10d2-4e7a-baad-0ff0d61279ff => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 22 11:14:05.168660 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-4c56128b-9d98-49a9-a4ad-b8c08da9ef68 tempest-VolumesSnapshotsTestJSON-386867167 tempest-VolumesSnapshotsTestJSON-386867167-project] Calling method '.version_select at 0x7f8447015700>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:05.188187 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-f5e32a6a-a780-4e3d-9cd1-ed9d9cea0909 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Flavor limits 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 22 11:14:05.189252 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-f5e32a6a-a780-4e3d-9cd1-ed9d9cea0909 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Image limits 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 22 11:14:05.190570 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-f5e32a6a-a780-4e3d-9cd1-ed9d9cea0909 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Flavor pref 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 22 11:14:05.191029 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-f5e32a6a-a780-4e3d-9cd1-ed9d9cea0909 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Image pref 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 22 11:14:05.191552 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-f5e32a6a-a780-4e3d-9cd1-ed9d9cea0909 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 22 11:14:05.243028 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f5e32a6a-a780-4e3d-9cd1-ed9d9cea0909 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:05.243571 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f5e32a6a-a780-4e3d-9cd1-ed9d9cea0909 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:05.250295 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f5e32a6a-a780-4e3d-9cd1-ed9d9cea0909 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:05.250784 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f5e32a6a-a780-4e3d-9cd1-ed9d9cea0909 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:05.276321 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-4c56128b-9d98-49a9-a4ad-b8c08da9ef68 tempest-VolumesSnapshotsTestJSON-386867167 tempest-VolumesSnapshotsTestJSON-386867167-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/a81bae96-10d2-4e7a-baad-0ff0d61279ff" status: 200 len: 286 microversion: 2.1 time: 0.111716 Jul 22 11:14:05.276960 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 10/16] 10.222.0.20 () {58 vars in 1250 bytes} [Fri Jul 22 11:14:05 2022] GET /compute/v2.1/os-snapshots/a81bae96-10d2-4e7a-baad-0ff0d61279ff => generated 286 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 22 11:14:05.306095 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-f5e32a6a-a780-4e3d-9cd1-ed9d9cea0909 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Getting quotas for project 08cd35ed100244fdab3228d1afe62400. Resources: {'instances', 'cores', 'ram'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 22 11:14:05.312347 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-f5e32a6a-a780-4e3d-9cd1-ed9d9cea0909 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Getting quotas for user 5202e2bdba064c4aaa84e15e1f0f0dea and project 08cd35ed100244fdab3228d1afe62400. Resources: {'instances', 'cores', 'ram'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 22 11:14:05.329326 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-f5e32a6a-a780-4e3d-9cd1-ed9d9cea0909 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Going to run 1 instances... {{(pid=117885) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 22 11:14:05.333852 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-f5e32a6a-a780-4e3d-9cd1-ed9d9cea0909 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] [instance: 37f3ca38-a4e1-4c99-ace3-be7264f28e4e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1a6c3cb4-9f56-44c6-aa68-01000df27209',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 22 11:14:05.459630 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-f5e32a6a-a780-4e3d-9cd1-ed9d9cea0909 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.371430 Jul 22 11:14:05.466955 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 7/17] 10.222.0.20 () {60 vars in 1146 bytes} [Fri Jul 22 11:14:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 2380 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 22 11:14:05.472453 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-4ba87a98-07be-45f0-858c-1ab7b4ffdb61 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:05.473729 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-4ba87a98-07be-45f0-858c-1ab7b4ffdb61 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] [instance: 37f3ca38-a4e1-4c99-ace3-be7264f28e4e] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:06.166693 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-4ba87a98-07be-45f0-858c-1ab7b4ffdb61 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5202e2bdba064c4aaa84e15e1f0f0dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cd35ed100244fdab3228d1afe62400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:06.200664 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-4ba87a98-07be-45f0-858c-1ab7b4ffdb61 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] 10.222.0.20 "GET /compute/v2.1/servers/37f3ca38-a4e1-4c99-ace3-be7264f28e4e" status: 200 len: 1215 microversion: 2.1 time: 0.733333 Jul 22 11:14:06.210512 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 11/18] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:05 2022] GET /compute/v2.1/servers/37f3ca38-a4e1-4c99-ace3-be7264f28e4e => generated 1215 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:06.294599 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-a641dbb4-ff35-4980-8dbc-0c92dcf6f4cf tempest-VolumesSnapshotsTestJSON-386867167 tempest-VolumesSnapshotsTestJSON-386867167-project] Calling method '.version_select at 0x7f84466b6e50>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:06.420453 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-a641dbb4-ff35-4980-8dbc-0c92dcf6f4cf tempest-VolumesSnapshotsTestJSON-386867167 tempest-VolumesSnapshotsTestJSON-386867167-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/a81bae96-10d2-4e7a-baad-0ff0d61279ff" status: 200 len: 286 microversion: 2.1 time: 0.136574 Jul 22 11:14:06.425016 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 8/19] 10.222.0.20 () {58 vars in 1250 bytes} [Fri Jul 22 11:14:06 2022] GET /compute/v2.1/os-snapshots/a81bae96-10d2-4e7a-baad-0ff0d61279ff => generated 286 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:14:07.226172 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-05528c59-f502-4cd0-bb16-ff14f27e2954 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:07.226822 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-05528c59-f502-4cd0-bb16-ff14f27e2954 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] [instance: 37f3ca38-a4e1-4c99-ace3-be7264f28e4e] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:07.449690 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-b8b0e26d-d227-406a-9545-a839794595f3 tempest-VolumesSnapshotsTestJSON-386867167 tempest-VolumesSnapshotsTestJSON-386867167-project] Calling method '.version_select at 0x7f84466e55e0>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:07.561331 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-b8b0e26d-d227-406a-9545-a839794595f3 tempest-VolumesSnapshotsTestJSON-386867167 tempest-VolumesSnapshotsTestJSON-386867167-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/a81bae96-10d2-4e7a-baad-0ff0d61279ff" status: 200 len: 286 microversion: 2.1 time: 0.131608 Jul 22 11:14:07.563067 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 9/20] 10.222.0.20 () {58 vars in 1250 bytes} [Fri Jul 22 11:14:07 2022] GET /compute/v2.1/os-snapshots/a81bae96-10d2-4e7a-baad-0ff0d61279ff => generated 286 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:14:07.661394 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-05528c59-f502-4cd0-bb16-ff14f27e2954 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5202e2bdba064c4aaa84e15e1f0f0dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cd35ed100244fdab3228d1afe62400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:07.700164 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-05528c59-f502-4cd0-bb16-ff14f27e2954 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] 10.222.0.20 "GET /compute/v2.1/servers/37f3ca38-a4e1-4c99-ace3-be7264f28e4e" status: 200 len: 1215 microversion: 2.1 time: 0.475539 Jul 22 11:14:07.701919 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 12/21] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:07 2022] GET /compute/v2.1/servers/37f3ca38-a4e1-4c99-ace3-be7264f28e4e => generated 1215 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:08.573732 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-509e324e-9427-40ea-87a1-23dc63db507d tempest-VolumesSnapshotsTestJSON-386867167 tempest-VolumesSnapshotsTestJSON-386867167-project] Calling method '.version_select at 0x7f8446fd8dc0>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:08.577544 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-8c4dd100-ec09-4b74-b5c4-6bc1b1bfdb53 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2023122896", "imageRef": "1a6c3cb4-9f56-44c6-aa68-01000df27209", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:14:08.673968 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.wsgi [None req-509e324e-9427-40ea-87a1-23dc63db507d tempest-VolumesSnapshotsTestJSON-386867167 tempest-VolumesSnapshotsTestJSON-386867167-project] HTTP exception thrown: Snapshot a81bae96-10d2-4e7a-baad-0ff0d61279ff could not be found. Jul 22 11:14:08.684093 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.network.neutron [None req-8c4dd100-ec09-4b74-b5c4-6bc1b1bfdb53 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] validate_networks() for [('f4c83bdf-91ac-4a2c-a8da-a4ea4fc99527', None, None, None, None, None)] {{(pid=117885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 22 11:14:08.689180 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-509e324e-9427-40ea-87a1-23dc63db507d tempest-VolumesSnapshotsTestJSON-386867167 tempest-VolumesSnapshotsTestJSON-386867167-project] Request method failure captured: Jul 22 11:14:08.689180 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: request: GET /compute/v2.1/os-snapshots/a81bae96-10d2-4e7a-baad-0ff0d61279ff HTTP/1.1 Jul 22 11:14:08.689180 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Accept: application/json Jul 22 11:14:08.689180 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Accept-Encoding: identity Jul 22 11:14:08.689180 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Connection: close Jul 22 11:14:08.689180 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Content-Length: 0 Jul 22 11:14:08.689180 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Content-Type: application/json Jul 22 11:14:08.689180 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Host: 10.222.0.20 Jul 22 11:14:08.689180 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Openstack-System-Scope: None Jul 22 11:14:08.689180 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: User-Agent: python-urllib3/1.26.9 Jul 22 11:14:08.689180 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Auth-Token: gAAAAABi2oZu4QoeTmwqRL8UqA-H5Rg4gvuUupU1anpzMHpNQrNvqL1pjqNkPaUVD_1HC0KomwG0rO8kp9V2J3M-xniLDsLjITmOZ359h8l38_hI4SrKOAYZIlsO8BK_ooPDdVUqHWB7YgdbyrswWB8TKl5lyNnDPFIQD2El8lfHKpVbzm9glEM Jul 22 11:14:08.689180 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Domain-Id: None Jul 22 11:14:08.689180 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Domain-Name: None Jul 22 11:14:08.689180 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Identity-Status: Confirmed Jul 22 11:14:08.689180 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Is-Admin-Project: True Jul 22 11:14:08.689180 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Domain-Id: default Jul 22 11:14:08.689180 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Domain-Name: Default Jul 22 11:14:08.689180 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Id: a0ca7d833cb44d02aabc2d345df833f3 Jul 22 11:14:08.689180 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-386867167 Jul 22 11:14:08.689180 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Role: reader,member Jul 22 11:14:08.689180 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Roles: reader,member Jul 22 11:14:08.690884 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a0ca7d833cb44d02aabc2d345df833f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a0ca7d833cb44d02aabc2d345df833f3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a0ca7d833cb44d02aabc2d345df833f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a0ca7d833cb44d02aabc2d345df833f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jul 22 11:14:08.690884 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant: tempest-VolumesSnapshotsTestJSON-386867167 Jul 22 11:14:08.690884 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant-Id: a0ca7d833cb44d02aabc2d345df833f3 Jul 22 11:14:08.690884 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-386867167 Jul 22 11:14:08.690884 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User: tempest-VolumesSnapshotsTestJSON-386867167-project Jul 22 11:14:08.690884 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Domain-Id: default Jul 22 11:14:08.690884 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Domain-Name: Default Jul 22 11:14:08.690884 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Id: 81cf75f532a44b27930a8da72700d21a Jul 22 11:14:08.690884 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Name: tempest-VolumesSnapshotsTestJSON-386867167-project Jul 22 11:14:08.690884 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: method: Jul 22 11:14:08.690884 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: exception: Snapshot a81bae96-10d2-4e7a-baad-0ff0d61279ff could not be found. Jul 22 11:14:08.690884 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: action_args: {'id': 'a81bae96-10d2-4e7a-baad-0ff0d61279ff'} Jul 22 11:14:08.690884 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 22 11:14:08.691579 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:14:08.691579 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 22 11:14:08.691579 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 22 11:14:08.691579 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 22 11:14:08.691579 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 22 11:14:08.691579 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 22 11:14:08.691579 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 22 11:14:08.691579 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 22 11:14:08.691579 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 22 11:14:08.691579 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 22 11:14:08.691579 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 22 11:14:08.691579 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 22 11:14:08.691579 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 22 11:14:08.691579 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 22 11:14:08.691579 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 22 11:14:08.691579 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot a81bae96-10d2-4e7a-baad-0ff0d61279ff could not be found. (HTTP 404) (Request-ID: req-aed1dc40-a467-4db1-aa38-842066d4c252) Jul 22 11:14:08.691579 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:14:08.691579 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:14:08.692744 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:14:08.692744 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:14:08.692744 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 22 11:14:08.692744 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 22 11:14:08.692744 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 22 11:14:08.692744 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 22 11:14:08.692744 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 22 11:14:08.692744 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 22 11:14:08.692744 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 22 11:14:08.692744 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 22 11:14:08.692744 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 22 11:14:08.692744 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 22 11:14:08.692744 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 22 11:14:08.692744 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 22 11:14:08.692744 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 22 11:14:08.692744 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 22 11:14:08.692744 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 22 11:14:08.692744 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 22 11:14:08.692744 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 22 11:14:08.694006 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 22 11:14:08.694006 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 22 11:14:08.694006 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 22 11:14:08.694006 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 22 11:14:08.694006 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 22 11:14:08.694006 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot a81bae96-10d2-4e7a-baad-0ff0d61279ff could not be found. Jul 22 11:14:08.694006 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:14:08.694006 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:14:08.694006 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:14:08.694006 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:14:08.694006 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:14:08.694006 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:14:08.694006 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 22 11:14:08.694006 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 22 11:14:08.694006 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 22 11:14:08.694006 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 22 11:14:08.694006 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 22 11:14:08.694006 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 22 11:14:08.694006 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 22 11:14:08.694006 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 22 11:14:08.695011 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot a81bae96-10d2-4e7a-baad-0ff0d61279ff could not be found. Jul 22 11:14:08.695011 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:14:08.695011 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:14:08.695011 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:14:08.695011 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:14:08.695011 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:14:08.695011 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:14:08.695011 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 22 11:14:08.695011 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 22 11:14:08.695011 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot a81bae96-10d2-4e7a-baad-0ff0d61279ff could not be found. Jul 22 11:14:08.695011 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:14:08.721043 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-509e324e-9427-40ea-87a1-23dc63db507d tempest-VolumesSnapshotsTestJSON-386867167 tempest-VolumesSnapshotsTestJSON-386867167-project] Returning 404 to user: Snapshot a81bae96-10d2-4e7a-baad-0ff0d61279ff could not be found. {{(pid=117884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 22 11:14:08.724984 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-509e324e-9427-40ea-87a1-23dc63db507d tempest-VolumesSnapshotsTestJSON-386867167 tempest-VolumesSnapshotsTestJSON-386867167-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/a81bae96-10d2-4e7a-baad-0ff0d61279ff" status: 404 len: 111 microversion: 2.1 time: 0.153817 Jul 22 11:14:08.726857 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 13/22] 10.222.0.20 () {58 vars in 1250 bytes} [Fri Jul 22 11:14:08 2022] GET /compute/v2.1/os-snapshots/a81bae96-10d2-4e7a-baad-0ff0d61279ff => generated 111 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 22 11:14:08.747294 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-d63a575b-7980-45b3-9954-f89d1c99b0be tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:08.749542 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-d63a575b-7980-45b3-9954-f89d1c99b0be tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] [instance: 37f3ca38-a4e1-4c99-ace3-be7264f28e4e] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:08.773199 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-d63a575b-7980-45b3-9954-f89d1c99b0be tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:08.773966 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-d63a575b-7980-45b3-9954-f89d1c99b0be tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:08.775917 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-d63a575b-7980-45b3-9954-f89d1c99b0be tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:08.777500 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-d63a575b-7980-45b3-9954-f89d1c99b0be tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:09.658358 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-d63a575b-7980-45b3-9954-f89d1c99b0be tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5202e2bdba064c4aaa84e15e1f0f0dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cd35ed100244fdab3228d1afe62400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:09.725085 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-d63a575b-7980-45b3-9954-f89d1c99b0be tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] 10.222.0.20 "GET /compute/v2.1/servers/37f3ca38-a4e1-4c99-ace3-be7264f28e4e" status: 200 len: 1211 microversion: 2.1 time: 0.996119 Jul 22 11:14:09.728164 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 14/23] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:08 2022] GET /compute/v2.1/servers/37f3ca38-a4e1-4c99-ace3-be7264f28e4e => generated 1211 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:09.743214 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-45f6c30f-93f9-49bc-b6cc-edd9da216694 tempest-VolumesSnapshotsTestJSON-386867167 tempest-VolumesSnapshotsTestJSON-386867167-project] Calling method '.version_select at 0x7f8446ebc9d0>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:09.754297 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-8c4dd100-ec09-4b74-b5c4-6bc1b1bfdb53 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Flavor limits 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 22 11:14:09.755038 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-8c4dd100-ec09-4b74-b5c4-6bc1b1bfdb53 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Image limits 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 22 11:14:09.756018 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-8c4dd100-ec09-4b74-b5c4-6bc1b1bfdb53 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Flavor pref 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 22 11:14:09.759805 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-8c4dd100-ec09-4b74-b5c4-6bc1b1bfdb53 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Image pref 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 22 11:14:09.760381 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-8c4dd100-ec09-4b74-b5c4-6bc1b1bfdb53 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 22 11:14:09.790738 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8c4dd100-ec09-4b74-b5c4-6bc1b1bfdb53 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:09.791329 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8c4dd100-ec09-4b74-b5c4-6bc1b1bfdb53 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:09.792250 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8c4dd100-ec09-4b74-b5c4-6bc1b1bfdb53 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:09.792698 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8c4dd100-ec09-4b74-b5c4-6bc1b1bfdb53 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:09.843074 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-8c4dd100-ec09-4b74-b5c4-6bc1b1bfdb53 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Getting quotas for project 601d12851417478a8b39bbf0c9fcd03d. Resources: {'instances', 'cores', 'ram'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 22 11:14:09.850341 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-8c4dd100-ec09-4b74-b5c4-6bc1b1bfdb53 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Getting quotas for user 7c2c0270618240de8fd9290d01a7413a and project 601d12851417478a8b39bbf0c9fcd03d. Resources: {'instances', 'cores', 'ram'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 22 11:14:09.872959 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-45f6c30f-93f9-49bc-b6cc-edd9da216694 tempest-VolumesSnapshotsTestJSON-386867167 tempest-VolumesSnapshotsTestJSON-386867167-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/32987e25-1c75-405f-b1e5-f152b4f38a7b" status: 202 len: 0 microversion: 2.1 time: 0.140588 Jul 22 11:14:09.874184 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 15/24] 10.222.0.20 () {58 vars in 1247 bytes} [Fri Jul 22 11:14:09 2022] DELETE /compute/v2.1/os-volumes/32987e25-1c75-405f-b1e5-f152b4f38a7b => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 22 11:14:09.878869 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-8c4dd100-ec09-4b74-b5c4-6bc1b1bfdb53 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Going to run 1 instances... {{(pid=117885) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 22 11:14:09.884107 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-8c4dd100-ec09-4b74-b5c4-6bc1b1bfdb53 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: fbf8cb41-3496-45fe-9392-6add8f6873d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1a6c3cb4-9f56-44c6-aa68-01000df27209',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 22 11:14:09.885540 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-2a01a938-ec40-4cda-a277-5be8c54702d5 tempest-VolumesSnapshotsTestJSON-386867167 tempest-VolumesSnapshotsTestJSON-386867167-project] Calling method '.version_select at 0x7f8446ec7160>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:09.975461 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-2a01a938-ec40-4cda-a277-5be8c54702d5 tempest-VolumesSnapshotsTestJSON-386867167 tempest-VolumesSnapshotsTestJSON-386867167-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/32987e25-1c75-405f-b1e5-f152b4f38a7b" status: 200 len: 344 microversion: 2.1 time: 0.095825 Jul 22 11:14:09.976616 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 16/25] 10.222.0.20 () {58 vars in 1244 bytes} [Fri Jul 22 11:14:09 2022] GET /compute/v2.1/os-volumes/32987e25-1c75-405f-b1e5-f152b4f38a7b => generated 344 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 22 11:14:09.989458 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-8c4dd100-ec09-4b74-b5c4-6bc1b1bfdb53 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.679974 Jul 22 11:14:10.005948 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 10/26] 10.222.0.20 () {60 vars in 1146 bytes} [Fri Jul 22 11:14:08 2022] POST /compute/v2.1/servers => generated 383 bytes in 1697 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 22 11:14:10.026773 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-fe270d81-d287-4a69-812a-d9afcc1a9110 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:10.028482 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-fe270d81-d287-4a69-812a-d9afcc1a9110 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: fbf8cb41-3496-45fe-9392-6add8f6873d0] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:10.186185 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-fe270d81-d287-4a69-812a-d9afcc1a9110 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:10.200766 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-fe270d81-d287-4a69-812a-d9afcc1a9110 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0" status: 200 len: 1222 microversion: 2.1 time: 0.194615 Jul 22 11:14:10.201765 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 17/27] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:10 2022] GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0 => generated 1222 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:10.419715 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-731ef8ac-ed5d-410d-b60c-cedf5bc905d2 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1560814795", "imageRef": "1a6c3cb4-9f56-44c6-aa68-01000df27209", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:14:10.520400 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.network.neutron [None req-731ef8ac-ed5d-410d-b60c-cedf5bc905d2 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] validate_networks() for [('f4c83bdf-91ac-4a2c-a8da-a4ea4fc99527', None, None, None, None, None)] {{(pid=117885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 22 11:14:10.746717 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-c12712e9-5452-4993-945b-76f7cb019fcc tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:10.747690 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-c12712e9-5452-4993-945b-76f7cb019fcc tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] [instance: 37f3ca38-a4e1-4c99-ace3-be7264f28e4e] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:10.764373 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c12712e9-5452-4993-945b-76f7cb019fcc tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:10.764954 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c12712e9-5452-4993-945b-76f7cb019fcc tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:10.768158 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c12712e9-5452-4993-945b-76f7cb019fcc tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:10.774426 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c12712e9-5452-4993-945b-76f7cb019fcc tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:10.963000 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-c12712e9-5452-4993-945b-76f7cb019fcc tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5202e2bdba064c4aaa84e15e1f0f0dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cd35ed100244fdab3228d1afe62400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:10.975635 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-c12712e9-5452-4993-945b-76f7cb019fcc tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] 10.222.0.20 "GET /compute/v2.1/servers/37f3ca38-a4e1-4c99-ace3-be7264f28e4e" status: 200 len: 1275 microversion: 2.1 time: 0.234861 Jul 22 11:14:10.996588 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 18/28] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:10 2022] GET /compute/v2.1/servers/37f3ca38-a4e1-4c99-ace3-be7264f28e4e => generated 1275 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:14:11.008954 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-4de3a65d-da1f-4dc0-8975-a1af6bc6bcd7 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-498582605", "imageRef": "1a6c3cb4-9f56-44c6-aa68-01000df27209", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "32cd3386-64da-4740-85d1-ffc0b29096eb"}], "security_groups": [{"name": "tempest-securitygroup--867220446"}], "key_name": "tempest-keypair-1251284060", "user_data": "}} {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:14:11.378209 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-731ef8ac-ed5d-410d-b60c-cedf5bc905d2 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Flavor limits 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 22 11:14:11.379824 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-731ef8ac-ed5d-410d-b60c-cedf5bc905d2 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Image limits 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 22 11:14:11.380323 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-731ef8ac-ed5d-410d-b60c-cedf5bc905d2 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Flavor pref 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 22 11:14:11.380741 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-731ef8ac-ed5d-410d-b60c-cedf5bc905d2 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Image pref 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 22 11:14:11.381162 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-731ef8ac-ed5d-410d-b60c-cedf5bc905d2 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 22 11:14:11.402386 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-731ef8ac-ed5d-410d-b60c-cedf5bc905d2 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:11.406767 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-731ef8ac-ed5d-410d-b60c-cedf5bc905d2 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:11.409339 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-731ef8ac-ed5d-410d-b60c-cedf5bc905d2 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:11.410383 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-731ef8ac-ed5d-410d-b60c-cedf5bc905d2 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:11.426218 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.network.neutron [None req-4de3a65d-da1f-4dc0-8975-a1af6bc6bcd7 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] validate_networks() for [('32cd3386-64da-4740-85d1-ffc0b29096eb', None, None, None, None, None)] {{(pid=117884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 22 11:14:11.453916 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-731ef8ac-ed5d-410d-b60c-cedf5bc905d2 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Getting quotas for project 601d12851417478a8b39bbf0c9fcd03d. Resources: {'instances', 'cores', 'ram'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 22 11:14:11.462466 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-731ef8ac-ed5d-410d-b60c-cedf5bc905d2 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Getting quotas for user 7c2c0270618240de8fd9290d01a7413a and project 601d12851417478a8b39bbf0c9fcd03d. Resources: {'instances', 'cores', 'ram'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 22 11:14:11.489295 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-731ef8ac-ed5d-410d-b60c-cedf5bc905d2 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Going to run 1 instances... {{(pid=117885) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 22 11:14:11.498662 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-731ef8ac-ed5d-410d-b60c-cedf5bc905d2 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 3108d9e0-3b2d-402a-aaab-c313c30e7900] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1a6c3cb4-9f56-44c6-aa68-01000df27209',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 22 11:14:11.708227 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-731ef8ac-ed5d-410d-b60c-cedf5bc905d2 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.295012 Jul 22 11:14:11.711078 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 11/29] 10.222.0.20 () {60 vars in 1146 bytes} [Fri Jul 22 11:14:10 2022] POST /compute/v2.1/servers => generated 383 bytes in 1300 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 22 11:14:11.716587 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-42f3905b-3857-4480-b4f1-cacc19631ab8 tempest-VolumesSnapshotsTestJSON-386867167 tempest-VolumesSnapshotsTestJSON-386867167-project] Calling method '.version_select at 0x7f84466e5b80>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:11.919001 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-42f3905b-3857-4480-b4f1-cacc19631ab8 tempest-VolumesSnapshotsTestJSON-386867167 tempest-VolumesSnapshotsTestJSON-386867167-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/32987e25-1c75-405f-b1e5-f152b4f38a7b" status: 200 len: 344 microversion: 2.1 time: 0.206355 Jul 22 11:14:11.920948 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 12/30] 10.222.0.20 () {58 vars in 1244 bytes} [Fri Jul 22 11:14:11 2022] GET /compute/v2.1/os-volumes/32987e25-1c75-405f-b1e5-f152b4f38a7b => generated 344 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:14:12.170901 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-d926eeec-8f1a-41f2-9323-e4fe4dad12a8 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Action: 'create', calling method: .version_select at 0x7f84466b6ee0>, body: {"keypair": {"name": "tempest-keypair-5927667", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKDUmCJja3yDJWDVJC+R/EnlNCNyvU4jjqkd63NzVFA+eK6+FFHgp7xc6dBwZdfqIQSMiUE8xMAzWvHYF+tGfGGsMHFREpbQGikumpT7jm3q6m6asqJABBzWs/I7VHyT6w=="}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:14:12.210005 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-d926eeec-8f1a-41f2-9323-e4fe4dad12a8 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Getting quotas for project f50a15db11214fb5a637fb400dcd928f. Resources: {'key_pairs'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 22 11:14:12.218453 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-d926eeec-8f1a-41f2-9323-e4fe4dad12a8 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Getting quotas for user da75b78b267f47e8aaaafb41e3acb61a and project f50a15db11214fb5a637fb400dcd928f. Resources: {'key_pairs'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 22 11:14:12.307019 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-d926eeec-8f1a-41f2-9323-e4fe4dad12a8 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 383 microversion: 2.1 time: 0.380333 Jul 22 11:14:12.315373 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 13/31] 10.222.0.20 () {60 vars in 1158 bytes} [Fri Jul 22 11:14:11 2022] POST /compute/v2.1/os-keypairs => generated 383 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:14:12.348105 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-dadb693e-a81c-48a1-98f9-f978f5a4f36a tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:12.352081 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-dadb693e-a81c-48a1-98f9-f978f5a4f36a tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 3108d9e0-3b2d-402a-aaab-c313c30e7900] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:13.554466 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-dadb693e-a81c-48a1-98f9-f978f5a4f36a tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:13.631458 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-dadb693e-a81c-48a1-98f9-f978f5a4f36a tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900" status: 200 len: 1222 microversion: 2.1 time: 1.311103 Jul 22 11:14:13.641262 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 14/32] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:12 2022] GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900 => generated 1222 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:13.663698 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-89e92f87-bc7d-41a3-a103-00bdd216533a tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:13.664373 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-89e92f87-bc7d-41a3-a103-00bdd216533a tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] [instance: 37f3ca38-a4e1-4c99-ace3-be7264f28e4e] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:13.684368 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.virt.hardware [None req-4de3a65d-da1f-4dc0-8975-a1af6bc6bcd7 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Flavor limits 0:0:0 {{(pid=117884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 22 11:14:13.685017 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.virt.hardware [None req-4de3a65d-da1f-4dc0-8975-a1af6bc6bcd7 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Image limits 0:0:0 {{(pid=117884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 22 11:14:13.685654 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.virt.hardware [None req-4de3a65d-da1f-4dc0-8975-a1af6bc6bcd7 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Flavor pref 0:0:0 {{(pid=117884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 22 11:14:13.686630 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.virt.hardware [None req-4de3a65d-da1f-4dc0-8975-a1af6bc6bcd7 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Image pref 0:0:0 {{(pid=117884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 22 11:14:13.687050 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.virt.hardware [None req-4de3a65d-da1f-4dc0-8975-a1af6bc6bcd7 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 22 11:14:13.730216 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-89e92f87-bc7d-41a3-a103-00bdd216533a tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:13.733602 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-89e92f87-bc7d-41a3-a103-00bdd216533a tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:13.735496 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-89e92f87-bc7d-41a3-a103-00bdd216533a tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:13.739814 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-89e92f87-bc7d-41a3-a103-00bdd216533a tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:13.751409 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-4de3a65d-da1f-4dc0-8975-a1af6bc6bcd7 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:13.751859 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-4de3a65d-da1f-4dc0-8975-a1af6bc6bcd7 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:13.752723 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-4de3a65d-da1f-4dc0-8975-a1af6bc6bcd7 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:13.753181 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-4de3a65d-da1f-4dc0-8975-a1af6bc6bcd7 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:13.885717 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.quota [None req-4de3a65d-da1f-4dc0-8975-a1af6bc6bcd7 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Getting quotas for project 28836b7cb9c646aaaa1bb1c1fae68128. Resources: {'instances', 'cores', 'ram'} {{(pid=117884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 22 11:14:13.901389 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.quota [None req-4de3a65d-da1f-4dc0-8975-a1af6bc6bcd7 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Getting quotas for user 691877dce1024aeda61629073d74602b and project 28836b7cb9c646aaaa1bb1c1fae68128. Resources: {'instances', 'cores', 'ram'} {{(pid=117884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 22 11:14:13.956862 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-4de3a65d-da1f-4dc0-8975-a1af6bc6bcd7 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Going to run 1 instances... {{(pid=117884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 22 11:14:13.960421 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-4de3a65d-da1f-4dc0-8975-a1af6bc6bcd7 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 0501f722-7553-4cba-9675-7bcbabb72887] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1a6c3cb4-9f56-44c6-aa68-01000df27209',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 22 11:14:14.120327 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-4de3a65d-da1f-4dc0-8975-a1af6bc6bcd7 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.121966 Jul 22 11:14:14.122600 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 19/33] 10.222.0.20 () {60 vars in 1146 bytes} [Fri Jul 22 11:14:10 2022] POST /compute/v2.1/servers => generated 401 bytes in 3125 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 22 11:14:14.134639 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-8d0c4512-df9a-4784-a388-a22fcb2c4a8b tempest-VolumesSnapshotsTestJSON-386867167 tempest-VolumesSnapshotsTestJSON-386867167-project] Calling method '.version_select at 0x7f8446584c10>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:14.321692 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-8d0c4512-df9a-4784-a388-a22fcb2c4a8b tempest-VolumesSnapshotsTestJSON-386867167 tempest-VolumesSnapshotsTestJSON-386867167-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/32987e25-1c75-405f-b1e5-f152b4f38a7b" status: 200 len: 344 microversion: 2.1 time: 0.197097 Jul 22 11:14:14.322274 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 20/34] 10.222.0.20 () {58 vars in 1244 bytes} [Fri Jul 22 11:14:14 2022] GET /compute/v2.1/os-volumes/32987e25-1c75-405f-b1e5-f152b4f38a7b => generated 344 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:14:14.334333 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-5e73a9be-a17f-4193-84cc-f718c13f0efc tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:14.337402 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-5e73a9be-a17f-4193-84cc-f718c13f0efc tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 0501f722-7553-4cba-9675-7bcbabb72887] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:14.683740 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-89e92f87-bc7d-41a3-a103-00bdd216533a tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5202e2bdba064c4aaa84e15e1f0f0dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cd35ed100244fdab3228d1afe62400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:14.712625 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-89e92f87-bc7d-41a3-a103-00bdd216533a tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] 10.222.0.20 "GET /compute/v2.1/servers/37f3ca38-a4e1-4c99-ace3-be7264f28e4e" status: 200 len: 1273 microversion: 2.1 time: 1.067982 Jul 22 11:14:14.738749 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 15/35] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:13 2022] GET /compute/v2.1/servers/37f3ca38-a4e1-4c99-ace3-be7264f28e4e => generated 1273 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:14.764349 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-f002090b-1790-4468-b16a-9c6b68f70747 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:14.766931 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-f002090b-1790-4468-b16a-9c6b68f70747 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 3108d9e0-3b2d-402a-aaab-c313c30e7900] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:14.780944 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f002090b-1790-4468-b16a-9c6b68f70747 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:14.791551 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f002090b-1790-4468-b16a-9c6b68f70747 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:14.798564 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f002090b-1790-4468-b16a-9c6b68f70747 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:14.802762 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-5e73a9be-a17f-4193-84cc-f718c13f0efc tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:14.803895 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f002090b-1790-4468-b16a-9c6b68f70747 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:14.817243 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-5e73a9be-a17f-4193-84cc-f718c13f0efc tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887" status: 200 len: 1241 microversion: 2.1 time: 0.493726 Jul 22 11:14:14.828572 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 21/36] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:14 2022] GET /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887 => generated 1241 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:15.012822 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-f002090b-1790-4468-b16a-9c6b68f70747 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:15.023943 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-f002090b-1790-4468-b16a-9c6b68f70747 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900" status: 200 len: 1226 microversion: 2.1 time: 0.282612 Jul 22 11:14:15.025428 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 16/37] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:14 2022] GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900 => generated 1226 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:15.334984 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-f7d78d90-8362-4f5f-9fff-6d9ab1179852 tempest-VolumesSnapshotsTestJSON-386867167 tempest-VolumesSnapshotsTestJSON-386867167-project] Calling method '.version_select at 0x7f84465a7790>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:15.490745 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-f7d78d90-8362-4f5f-9fff-6d9ab1179852 tempest-VolumesSnapshotsTestJSON-386867167 tempest-VolumesSnapshotsTestJSON-386867167-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/32987e25-1c75-405f-b1e5-f152b4f38a7b" status: 200 len: 344 microversion: 2.1 time: 0.160431 Jul 22 11:14:15.491361 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 22/38] 10.222.0.20 () {58 vars in 1244 bytes} [Fri Jul 22 11:14:15 2022] GET /compute/v2.1/os-volumes/32987e25-1c75-405f-b1e5-f152b4f38a7b => generated 344 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:14:15.731567 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-3c4a3936-65f4-42b2-9ad9-3200ed99b4cf tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:15.732826 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-3c4a3936-65f4-42b2-9ad9-3200ed99b4cf tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] [instance: 37f3ca38-a4e1-4c99-ace3-be7264f28e4e] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:15.749364 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3c4a3936-65f4-42b2-9ad9-3200ed99b4cf tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:15.750276 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3c4a3936-65f4-42b2-9ad9-3200ed99b4cf tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:15.751920 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3c4a3936-65f4-42b2-9ad9-3200ed99b4cf tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:15.753232 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3c4a3936-65f4-42b2-9ad9-3200ed99b4cf tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:15.835148 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-f39058a8-f22c-44a1-aa16-ea793e300666 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:15.835920 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-f39058a8-f22c-44a1-aa16-ea793e300666 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 0501f722-7553-4cba-9675-7bcbabb72887] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:15.849815 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f39058a8-f22c-44a1-aa16-ea793e300666 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:15.850277 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f39058a8-f22c-44a1-aa16-ea793e300666 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:15.851096 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f39058a8-f22c-44a1-aa16-ea793e300666 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:15.851573 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f39058a8-f22c-44a1-aa16-ea793e300666 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:15.953526 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-f39058a8-f22c-44a1-aa16-ea793e300666 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:15.963869 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-3c4a3936-65f4-42b2-9ad9-3200ed99b4cf tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5202e2bdba064c4aaa84e15e1f0f0dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cd35ed100244fdab3228d1afe62400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:15.967290 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-f39058a8-f22c-44a1-aa16-ea793e300666 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887" status: 200 len: 1245 microversion: 2.1 time: 0.134959 Jul 22 11:14:15.968568 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 23/39] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:15 2022] GET /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887 => generated 1245 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:15.981933 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-3c4a3936-65f4-42b2-9ad9-3200ed99b4cf tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] 10.222.0.20 "GET /compute/v2.1/servers/37f3ca38-a4e1-4c99-ace3-be7264f28e4e" status: 200 len: 1315 microversion: 2.1 time: 0.254886 Jul 22 11:14:15.982958 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 17/40] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:15 2022] GET /compute/v2.1/servers/37f3ca38-a4e1-4c99-ace3-be7264f28e4e => generated 1315 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:16.054702 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-8cb40380-ef40-496f-8540-db312537ea4f tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:16.055696 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-8cb40380-ef40-496f-8540-db312537ea4f tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 3108d9e0-3b2d-402a-aaab-c313c30e7900] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:16.066532 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-8cb40380-ef40-496f-8540-db312537ea4f tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:16.067652 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-8cb40380-ef40-496f-8540-db312537ea4f tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:16.068630 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-8cb40380-ef40-496f-8540-db312537ea4f tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:16.070108 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-8cb40380-ef40-496f-8540-db312537ea4f tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:16.166584 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-8cb40380-ef40-496f-8540-db312537ea4f tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:16.185234 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-8cb40380-ef40-496f-8540-db312537ea4f tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900" status: 200 len: 1226 microversion: 2.1 time: 0.129045 Jul 22 11:14:16.185234 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 24/41] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:16 2022] GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900 => generated 1226 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:16.205035 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-95b39169-80e1-4556-8f50-c0607a5bbc83 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1979036132", "imageRef": "1a6c3cb4-9f56-44c6-aa68-01000df27209", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a5e21a67-be78-4f6f-a34d-4e6e3696796e"}], "security_groups": [{"name": "tempest-securitygroup--450827585"}], "key_name": "tempest-keypair-5927667", "user_data": "}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:14:16.510110 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-42f7be74-4531-4e40-9715-0f5d55d0cac1 tempest-VolumesSnapshotsTestJSON-386867167 tempest-VolumesSnapshotsTestJSON-386867167-project] Calling method '.version_select at 0x7f8445d39700>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:16.718703 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-42f7be74-4531-4e40-9715-0f5d55d0cac1 tempest-VolumesSnapshotsTestJSON-386867167 tempest-VolumesSnapshotsTestJSON-386867167-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/32987e25-1c75-405f-b1e5-f152b4f38a7b" status: 200 len: 344 microversion: 2.1 time: 0.217269 Jul 22 11:14:16.726740 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 25/42] 10.222.0.20 () {58 vars in 1244 bytes} [Fri Jul 22 11:14:16 2022] GET /compute/v2.1/os-volumes/32987e25-1c75-405f-b1e5-f152b4f38a7b => generated 344 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:14:16.767223 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.network.neutron [None req-95b39169-80e1-4556-8f50-c0607a5bbc83 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] validate_networks() for [('a5e21a67-be78-4f6f-a34d-4e6e3696796e', None, None, None, None, None)] {{(pid=117885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 22 11:14:16.988062 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-dfe6bbfe-dc0c-45ed-bc33-db578fb5a99b tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:16.990995 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-dfe6bbfe-dc0c-45ed-bc33-db578fb5a99b tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 0501f722-7553-4cba-9675-7bcbabb72887] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:17.007592 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-dfe6bbfe-dc0c-45ed-bc33-db578fb5a99b tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:17.008241 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-dfe6bbfe-dc0c-45ed-bc33-db578fb5a99b tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:17.010927 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-dfe6bbfe-dc0c-45ed-bc33-db578fb5a99b tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:17.020370 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-dfe6bbfe-dc0c-45ed-bc33-db578fb5a99b tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:17.569476 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-dfe6bbfe-dc0c-45ed-bc33-db578fb5a99b tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:17.578008 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-dfe6bbfe-dc0c-45ed-bc33-db578fb5a99b tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887" status: 200 len: 1237 microversion: 2.1 time: 0.595428 Jul 22 11:14:17.582380 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 26/43] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:16 2022] GET /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887 => generated 1237 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:14:17.596035 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-5a89f2df-0d30-4932-ab02-6fa2ce49a80b tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:17.597114 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-5a89f2df-0d30-4932-ab02-6fa2ce49a80b tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] [instance: 37f3ca38-a4e1-4c99-ace3-be7264f28e4e] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:17.603711 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-5a89f2df-0d30-4932-ab02-6fa2ce49a80b tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:17.604169 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-5a89f2df-0d30-4932-ab02-6fa2ce49a80b tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:17.605109 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-5a89f2df-0d30-4932-ab02-6fa2ce49a80b tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:17.605556 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-5a89f2df-0d30-4932-ab02-6fa2ce49a80b tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:18.267983 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-5a89f2df-0d30-4932-ab02-6fa2ce49a80b tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5202e2bdba064c4aaa84e15e1f0f0dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cd35ed100244fdab3228d1afe62400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:18.284851 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-5a89f2df-0d30-4932-ab02-6fa2ce49a80b tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] 10.222.0.20 "GET /compute/v2.1/servers/37f3ca38-a4e1-4c99-ace3-be7264f28e4e" status: 200 len: 1315 microversion: 2.1 time: 0.699949 Jul 22 11:14:18.289860 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 27/44] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:17 2022] GET /compute/v2.1/servers/37f3ca38-a4e1-4c99-ace3-be7264f28e4e => generated 1315 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:18.296220 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-c889e94c-3bbb-463c-9154-0ac81970318e tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:18.297054 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-c889e94c-3bbb-463c-9154-0ac81970318e tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 3108d9e0-3b2d-402a-aaab-c313c30e7900] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:18.305495 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c889e94c-3bbb-463c-9154-0ac81970318e tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:18.306249 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c889e94c-3bbb-463c-9154-0ac81970318e tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:18.307227 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c889e94c-3bbb-463c-9154-0ac81970318e tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:18.307946 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c889e94c-3bbb-463c-9154-0ac81970318e tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:18.686580 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-c889e94c-3bbb-463c-9154-0ac81970318e tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:18.705604 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-c889e94c-3bbb-463c-9154-0ac81970318e tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900" status: 200 len: 1274 microversion: 2.1 time: 0.413215 Jul 22 11:14:18.707067 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 28/45] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:18 2022] GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900 => generated 1274 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:18.712676 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-82b9b237-4295-4382-9cc5-db0ff6289771 tempest-VolumesSnapshotsTestJSON-386867167 tempest-VolumesSnapshotsTestJSON-386867167-project] Calling method '.version_select at 0x7f8445d46e50>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:18.755948 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.wsgi [None req-82b9b237-4295-4382-9cc5-db0ff6289771 tempest-VolumesSnapshotsTestJSON-386867167 tempest-VolumesSnapshotsTestJSON-386867167-project] HTTP exception thrown: Volume 32987e25-1c75-405f-b1e5-f152b4f38a7b could not be found. Jul 22 11:14:18.759150 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-82b9b237-4295-4382-9cc5-db0ff6289771 tempest-VolumesSnapshotsTestJSON-386867167 tempest-VolumesSnapshotsTestJSON-386867167-project] Request method failure captured: Jul 22 11:14:18.759150 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: request: GET /compute/v2.1/os-volumes/32987e25-1c75-405f-b1e5-f152b4f38a7b HTTP/1.1 Jul 22 11:14:18.759150 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Accept: application/json Jul 22 11:14:18.759150 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Accept-Encoding: identity Jul 22 11:14:18.759150 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Connection: close Jul 22 11:14:18.759150 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Content-Length: 0 Jul 22 11:14:18.759150 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Content-Type: application/json Jul 22 11:14:18.759150 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Host: 10.222.0.20 Jul 22 11:14:18.759150 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Openstack-System-Scope: None Jul 22 11:14:18.759150 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: User-Agent: python-urllib3/1.26.9 Jul 22 11:14:18.759150 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Auth-Token: gAAAAABi2oZu4QoeTmwqRL8UqA-H5Rg4gvuUupU1anpzMHpNQrNvqL1pjqNkPaUVD_1HC0KomwG0rO8kp9V2J3M-xniLDsLjITmOZ359h8l38_hI4SrKOAYZIlsO8BK_ooPDdVUqHWB7YgdbyrswWB8TKl5lyNnDPFIQD2El8lfHKpVbzm9glEM Jul 22 11:14:18.759150 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Domain-Id: None Jul 22 11:14:18.759150 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Domain-Name: None Jul 22 11:14:18.759150 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Identity-Status: Confirmed Jul 22 11:14:18.759150 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Is-Admin-Project: True Jul 22 11:14:18.759150 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Domain-Id: default Jul 22 11:14:18.759150 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Domain-Name: Default Jul 22 11:14:18.759150 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Id: a0ca7d833cb44d02aabc2d345df833f3 Jul 22 11:14:18.759150 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-386867167 Jul 22 11:14:18.759150 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Role: reader,member Jul 22 11:14:18.759150 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Roles: reader,member Jul 22 11:14:18.760583 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a0ca7d833cb44d02aabc2d345df833f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a0ca7d833cb44d02aabc2d345df833f3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a0ca7d833cb44d02aabc2d345df833f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a0ca7d833cb44d02aabc2d345df833f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jul 22 11:14:18.760583 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant: tempest-VolumesSnapshotsTestJSON-386867167 Jul 22 11:14:18.760583 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant-Id: a0ca7d833cb44d02aabc2d345df833f3 Jul 22 11:14:18.760583 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-386867167 Jul 22 11:14:18.760583 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User: tempest-VolumesSnapshotsTestJSON-386867167-project Jul 22 11:14:18.760583 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Domain-Id: default Jul 22 11:14:18.760583 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Domain-Name: Default Jul 22 11:14:18.760583 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Id: 81cf75f532a44b27930a8da72700d21a Jul 22 11:14:18.760583 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Name: tempest-VolumesSnapshotsTestJSON-386867167-project Jul 22 11:14:18.760583 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: method: Jul 22 11:14:18.760583 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: exception: Volume 32987e25-1c75-405f-b1e5-f152b4f38a7b could not be found. Jul 22 11:14:18.760583 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: action_args: {'id': '32987e25-1c75-405f-b1e5-f152b4f38a7b'} Jul 22 11:14:18.760583 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 22 11:14:18.761383 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:14:18.761383 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 22 11:14:18.761383 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 22 11:14:18.761383 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 22 11:14:18.761383 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 22 11:14:18.761383 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 22 11:14:18.761383 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 22 11:14:18.761383 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 22 11:14:18.761383 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 22 11:14:18.761383 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 22 11:14:18.761383 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 22 11:14:18.761383 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 22 11:14:18.761383 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 22 11:14:18.761383 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 22 11:14:18.761383 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 22 11:14:18.761383 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 32987e25-1c75-405f-b1e5-f152b4f38a7b could not be found. (HTTP 404) (Request-ID: req-836ab068-cd83-4ff5-9008-1ed4d1c90319) Jul 22 11:14:18.761383 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:14:18.761383 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:14:18.761383 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:14:18.763470 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:14:18.763470 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 22 11:14:18.763470 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 22 11:14:18.763470 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 22 11:14:18.763470 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 22 11:14:18.763470 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 22 11:14:18.763470 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 22 11:14:18.763470 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 22 11:14:18.763470 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 22 11:14:18.763470 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 22 11:14:18.763470 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 22 11:14:18.763470 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 22 11:14:18.763470 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 22 11:14:18.763470 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 22 11:14:18.763470 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 22 11:14:18.763470 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 22 11:14:18.763470 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 22 11:14:18.763470 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 22 11:14:18.763470 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 22 11:14:18.764557 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 22 11:14:18.764557 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 22 11:14:18.764557 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 22 11:14:18.764557 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 22 11:14:18.764557 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 32987e25-1c75-405f-b1e5-f152b4f38a7b could not be found. Jul 22 11:14:18.764557 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:14:18.764557 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:14:18.764557 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:14:18.764557 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:14:18.764557 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:14:18.764557 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:14:18.764557 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 22 11:14:18.764557 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 22 11:14:18.764557 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 22 11:14:18.764557 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 22 11:14:18.764557 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 22 11:14:18.764557 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 22 11:14:18.764557 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 22 11:14:18.764557 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 22 11:14:18.765809 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 32987e25-1c75-405f-b1e5-f152b4f38a7b could not be found. Jul 22 11:14:18.765809 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:14:18.765809 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:14:18.765809 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:14:18.765809 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:14:18.765809 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:14:18.765809 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:14:18.765809 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 22 11:14:18.765809 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 22 11:14:18.765809 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 32987e25-1c75-405f-b1e5-f152b4f38a7b could not be found. Jul 22 11:14:18.765809 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:14:18.768718 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-82b9b237-4295-4382-9cc5-db0ff6289771 tempest-VolumesSnapshotsTestJSON-386867167 tempest-VolumesSnapshotsTestJSON-386867167-project] Returning 404 to user: Volume 32987e25-1c75-405f-b1e5-f152b4f38a7b could not be found. {{(pid=117884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 22 11:14:18.769890 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-82b9b237-4295-4382-9cc5-db0ff6289771 tempest-VolumesSnapshotsTestJSON-386867167 tempest-VolumesSnapshotsTestJSON-386867167-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/32987e25-1c75-405f-b1e5-f152b4f38a7b" status: 404 len: 109 microversion: 2.1 time: 0.061382 Jul 22 11:14:18.770616 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 29/46] 10.222.0.20 () {58 vars in 1244 bytes} [Fri Jul 22 11:14:18 2022] GET /compute/v2.1/os-volumes/32987e25-1c75-405f-b1e5-f152b4f38a7b => generated 109 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 22 11:14:18.776213 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-5efe14c5-4deb-4bd2-b1cb-1ee49bd32489 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:18.782121 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-5efe14c5-4deb-4bd2-b1cb-1ee49bd32489 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 0501f722-7553-4cba-9675-7bcbabb72887] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:18.791858 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-5efe14c5-4deb-4bd2-b1cb-1ee49bd32489 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:18.792563 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-5efe14c5-4deb-4bd2-b1cb-1ee49bd32489 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:18.793578 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-5efe14c5-4deb-4bd2-b1cb-1ee49bd32489 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:18.794260 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-5efe14c5-4deb-4bd2-b1cb-1ee49bd32489 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:19.137767 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-5efe14c5-4deb-4bd2-b1cb-1ee49bd32489 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:19.152324 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-5efe14c5-4deb-4bd2-b1cb-1ee49bd32489 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887" status: 200 len: 1293 microversion: 2.1 time: 0.380082 Jul 22 11:14:19.153678 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 30/47] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:18 2022] GET /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887 => generated 1293 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:19.164466 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-7bd1a14f-eafd-4f65-9cfb-6a025b79b273 tempest-VolumesSnapshotsTestJSON-386867167 tempest-VolumesSnapshotsTestJSON-386867167-project] Calling method '.version_select at 0x7f8445d5eee0>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:19.214444 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-95b39169-80e1-4556-8f50-c0607a5bbc83 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Flavor limits 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 22 11:14:19.216430 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-95b39169-80e1-4556-8f50-c0607a5bbc83 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Image limits 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 22 11:14:19.218745 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-95b39169-80e1-4556-8f50-c0607a5bbc83 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Flavor pref 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 22 11:14:19.219727 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-95b39169-80e1-4556-8f50-c0607a5bbc83 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Image pref 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 22 11:14:19.222971 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-95b39169-80e1-4556-8f50-c0607a5bbc83 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 22 11:14:19.226466 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.wsgi [None req-7bd1a14f-eafd-4f65-9cfb-6a025b79b273 tempest-VolumesSnapshotsTestJSON-386867167 tempest-VolumesSnapshotsTestJSON-386867167-project] HTTP exception thrown: Volume 32987e25-1c75-405f-b1e5-f152b4f38a7b could not be found. Jul 22 11:14:19.228429 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-7bd1a14f-eafd-4f65-9cfb-6a025b79b273 tempest-VolumesSnapshotsTestJSON-386867167 tempest-VolumesSnapshotsTestJSON-386867167-project] Request method failure captured: Jul 22 11:14:19.228429 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: request: DELETE /compute/v2.1/os-volumes/32987e25-1c75-405f-b1e5-f152b4f38a7b HTTP/1.1 Jul 22 11:14:19.228429 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Accept: application/json Jul 22 11:14:19.228429 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Accept-Encoding: identity Jul 22 11:14:19.228429 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Connection: close Jul 22 11:14:19.228429 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Content-Length: 0 Jul 22 11:14:19.228429 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Content-Type: application/json Jul 22 11:14:19.228429 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Host: 10.222.0.20 Jul 22 11:14:19.228429 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Openstack-System-Scope: None Jul 22 11:14:19.228429 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: User-Agent: python-urllib3/1.26.9 Jul 22 11:14:19.228429 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Auth-Token: gAAAAABi2oZu4QoeTmwqRL8UqA-H5Rg4gvuUupU1anpzMHpNQrNvqL1pjqNkPaUVD_1HC0KomwG0rO8kp9V2J3M-xniLDsLjITmOZ359h8l38_hI4SrKOAYZIlsO8BK_ooPDdVUqHWB7YgdbyrswWB8TKl5lyNnDPFIQD2El8lfHKpVbzm9glEM Jul 22 11:14:19.228429 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Domain-Id: None Jul 22 11:14:19.228429 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Domain-Name: None Jul 22 11:14:19.228429 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Identity-Status: Confirmed Jul 22 11:14:19.228429 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Is-Admin-Project: True Jul 22 11:14:19.228429 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Domain-Id: default Jul 22 11:14:19.228429 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Domain-Name: Default Jul 22 11:14:19.228429 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Id: a0ca7d833cb44d02aabc2d345df833f3 Jul 22 11:14:19.228429 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-386867167 Jul 22 11:14:19.228429 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Role: reader,member Jul 22 11:14:19.228429 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Roles: reader,member Jul 22 11:14:19.238475 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a0ca7d833cb44d02aabc2d345df833f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a0ca7d833cb44d02aabc2d345df833f3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a0ca7d833cb44d02aabc2d345df833f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a0ca7d833cb44d02aabc2d345df833f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jul 22 11:14:19.238475 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant: tempest-VolumesSnapshotsTestJSON-386867167 Jul 22 11:14:19.238475 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant-Id: a0ca7d833cb44d02aabc2d345df833f3 Jul 22 11:14:19.238475 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-386867167 Jul 22 11:14:19.238475 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User: tempest-VolumesSnapshotsTestJSON-386867167-project Jul 22 11:14:19.238475 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Domain-Id: default Jul 22 11:14:19.238475 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Domain-Name: Default Jul 22 11:14:19.238475 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Id: 81cf75f532a44b27930a8da72700d21a Jul 22 11:14:19.238475 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Name: tempest-VolumesSnapshotsTestJSON-386867167-project Jul 22 11:14:19.238475 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: method: Jul 22 11:14:19.238475 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: exception: Volume 32987e25-1c75-405f-b1e5-f152b4f38a7b could not be found. Jul 22 11:14:19.238475 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: action_args: {'id': '32987e25-1c75-405f-b1e5-f152b4f38a7b'} Jul 22 11:14:19.238475 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 22 11:14:19.242516 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:14:19.242516 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 22 11:14:19.242516 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 22 11:14:19.242516 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 22 11:14:19.242516 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 22 11:14:19.242516 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 22 11:14:19.242516 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 22 11:14:19.242516 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 22 11:14:19.242516 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 22 11:14:19.242516 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 22 11:14:19.242516 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 22 11:14:19.242516 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 22 11:14:19.242516 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 22 11:14:19.242516 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 22 11:14:19.242516 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 22 11:14:19.242516 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 32987e25-1c75-405f-b1e5-f152b4f38a7b could not be found. (HTTP 404) (Request-ID: req-d09cd54c-3c33-496b-a5f1-758305b981d2) Jul 22 11:14:19.242516 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:14:19.242516 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:14:19.242516 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:14:19.245224 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:14:19.245224 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 22 11:14:19.245224 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 22 11:14:19.245224 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 22 11:14:19.245224 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 22 11:14:19.245224 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 22 11:14:19.245224 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 22 11:14:19.245224 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 22 11:14:19.245224 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 22 11:14:19.245224 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 22 11:14:19.245224 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 22 11:14:19.245224 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 22 11:14:19.245224 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 22 11:14:19.245224 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 22 11:14:19.245224 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 22 11:14:19.245224 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 22 11:14:19.245224 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 22 11:14:19.245224 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 22 11:14:19.245224 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 22 11:14:19.247308 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 22 11:14:19.247308 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 22 11:14:19.247308 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 22 11:14:19.247308 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 22 11:14:19.247308 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 32987e25-1c75-405f-b1e5-f152b4f38a7b could not be found. Jul 22 11:14:19.247308 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:14:19.247308 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:14:19.247308 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:14:19.247308 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:14:19.247308 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:14:19.247308 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:14:19.247308 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 22 11:14:19.247308 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 22 11:14:19.247308 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 22 11:14:19.247308 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 22 11:14:19.247308 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 22 11:14:19.247308 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 22 11:14:19.247308 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 22 11:14:19.247308 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 22 11:14:19.254905 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 32987e25-1c75-405f-b1e5-f152b4f38a7b could not be found. Jul 22 11:14:19.254905 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:14:19.254905 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:14:19.254905 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:14:19.254905 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:14:19.254905 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:14:19.254905 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:14:19.254905 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 22 11:14:19.254905 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 22 11:14:19.254905 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 32987e25-1c75-405f-b1e5-f152b4f38a7b could not be found. Jul 22 11:14:19.254905 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:14:19.254905 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-7bd1a14f-eafd-4f65-9cfb-6a025b79b273 tempest-VolumesSnapshotsTestJSON-386867167 tempest-VolumesSnapshotsTestJSON-386867167-project] Returning 404 to user: Volume 32987e25-1c75-405f-b1e5-f152b4f38a7b could not be found. {{(pid=117884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 22 11:14:19.254905 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-7bd1a14f-eafd-4f65-9cfb-6a025b79b273 tempest-VolumesSnapshotsTestJSON-386867167 tempest-VolumesSnapshotsTestJSON-386867167-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/32987e25-1c75-405f-b1e5-f152b4f38a7b" status: 404 len: 109 microversion: 2.1 time: 0.072879 Jul 22 11:14:19.254905 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 31/48] 10.222.0.20 () {58 vars in 1247 bytes} [Fri Jul 22 11:14:19 2022] DELETE /compute/v2.1/os-volumes/32987e25-1c75-405f-b1e5-f152b4f38a7b => generated 109 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 22 11:14:19.257366 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-b2578c21-b953-4801-8ecb-863e6912b632 tempest-VolumesSnapshotsTestJSON-386867167 tempest-VolumesSnapshotsTestJSON-386867167-project] Calling method '.version_select at 0x7f8445d39160>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:19.300347 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-95b39169-80e1-4556-8f50-c0607a5bbc83 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:19.301121 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-95b39169-80e1-4556-8f50-c0607a5bbc83 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:19.302930 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-95b39169-80e1-4556-8f50-c0607a5bbc83 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:19.303435 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-95b39169-80e1-4556-8f50-c0607a5bbc83 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:19.305159 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.wsgi [None req-b2578c21-b953-4801-8ecb-863e6912b632 tempest-VolumesSnapshotsTestJSON-386867167 tempest-VolumesSnapshotsTestJSON-386867167-project] HTTP exception thrown: Volume 32987e25-1c75-405f-b1e5-f152b4f38a7b could not be found. Jul 22 11:14:19.307718 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-b2578c21-b953-4801-8ecb-863e6912b632 tempest-VolumesSnapshotsTestJSON-386867167 tempest-VolumesSnapshotsTestJSON-386867167-project] Request method failure captured: Jul 22 11:14:19.307718 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: request: GET /compute/v2.1/os-volumes/32987e25-1c75-405f-b1e5-f152b4f38a7b HTTP/1.1 Jul 22 11:14:19.307718 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Accept: application/json Jul 22 11:14:19.307718 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Accept-Encoding: identity Jul 22 11:14:19.307718 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Connection: close Jul 22 11:14:19.307718 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Content-Length: 0 Jul 22 11:14:19.307718 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Content-Type: application/json Jul 22 11:14:19.307718 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Host: 10.222.0.20 Jul 22 11:14:19.307718 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Openstack-System-Scope: None Jul 22 11:14:19.307718 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: User-Agent: python-urllib3/1.26.9 Jul 22 11:14:19.307718 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Auth-Token: gAAAAABi2oZu4QoeTmwqRL8UqA-H5Rg4gvuUupU1anpzMHpNQrNvqL1pjqNkPaUVD_1HC0KomwG0rO8kp9V2J3M-xniLDsLjITmOZ359h8l38_hI4SrKOAYZIlsO8BK_ooPDdVUqHWB7YgdbyrswWB8TKl5lyNnDPFIQD2El8lfHKpVbzm9glEM Jul 22 11:14:19.307718 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Domain-Id: None Jul 22 11:14:19.307718 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Domain-Name: None Jul 22 11:14:19.307718 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Identity-Status: Confirmed Jul 22 11:14:19.307718 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Is-Admin-Project: True Jul 22 11:14:19.307718 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Domain-Id: default Jul 22 11:14:19.307718 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Domain-Name: Default Jul 22 11:14:19.307718 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Id: a0ca7d833cb44d02aabc2d345df833f3 Jul 22 11:14:19.307718 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-386867167 Jul 22 11:14:19.307718 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Role: reader,member Jul 22 11:14:19.307718 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Roles: reader,member Jul 22 11:14:19.310126 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a0ca7d833cb44d02aabc2d345df833f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a0ca7d833cb44d02aabc2d345df833f3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a0ca7d833cb44d02aabc2d345df833f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a0ca7d833cb44d02aabc2d345df833f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jul 22 11:14:19.310126 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant: tempest-VolumesSnapshotsTestJSON-386867167 Jul 22 11:14:19.310126 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant-Id: a0ca7d833cb44d02aabc2d345df833f3 Jul 22 11:14:19.310126 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-386867167 Jul 22 11:14:19.310126 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User: tempest-VolumesSnapshotsTestJSON-386867167-project Jul 22 11:14:19.310126 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Domain-Id: default Jul 22 11:14:19.310126 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Domain-Name: Default Jul 22 11:14:19.310126 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Id: 81cf75f532a44b27930a8da72700d21a Jul 22 11:14:19.310126 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Name: tempest-VolumesSnapshotsTestJSON-386867167-project Jul 22 11:14:19.310126 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: method: Jul 22 11:14:19.310126 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: exception: Volume 32987e25-1c75-405f-b1e5-f152b4f38a7b could not be found. Jul 22 11:14:19.310126 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: action_args: {'id': '32987e25-1c75-405f-b1e5-f152b4f38a7b'} Jul 22 11:14:19.310126 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 22 11:14:19.311581 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:14:19.311581 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 22 11:14:19.311581 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 22 11:14:19.311581 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 22 11:14:19.311581 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 22 11:14:19.311581 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 22 11:14:19.311581 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 22 11:14:19.311581 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 22 11:14:19.311581 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 22 11:14:19.311581 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 22 11:14:19.311581 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 22 11:14:19.311581 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 22 11:14:19.311581 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 22 11:14:19.311581 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 22 11:14:19.311581 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 22 11:14:19.311581 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 32987e25-1c75-405f-b1e5-f152b4f38a7b could not be found. (HTTP 404) (Request-ID: req-68929ead-84ff-4224-939e-54a0188b4a0b) Jul 22 11:14:19.311581 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:14:19.311581 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:14:19.311581 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:14:19.313611 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:14:19.313611 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 22 11:14:19.313611 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 22 11:14:19.313611 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 22 11:14:19.313611 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 22 11:14:19.313611 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 22 11:14:19.313611 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 22 11:14:19.313611 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 22 11:14:19.313611 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 22 11:14:19.313611 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 22 11:14:19.313611 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 22 11:14:19.313611 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 22 11:14:19.313611 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 22 11:14:19.313611 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 22 11:14:19.313611 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 22 11:14:19.313611 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 22 11:14:19.313611 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 22 11:14:19.313611 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 22 11:14:19.313611 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 22 11:14:19.316393 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 22 11:14:19.316393 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 22 11:14:19.316393 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 22 11:14:19.316393 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 22 11:14:19.316393 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 32987e25-1c75-405f-b1e5-f152b4f38a7b could not be found. Jul 22 11:14:19.316393 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:14:19.316393 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:14:19.316393 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:14:19.316393 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:14:19.316393 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:14:19.316393 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:14:19.316393 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 22 11:14:19.316393 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 22 11:14:19.316393 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 22 11:14:19.316393 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 22 11:14:19.316393 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 22 11:14:19.316393 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 22 11:14:19.316393 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 22 11:14:19.316393 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 22 11:14:19.318634 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 32987e25-1c75-405f-b1e5-f152b4f38a7b could not be found. Jul 22 11:14:19.318634 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:14:19.318634 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:14:19.318634 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:14:19.318634 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:14:19.318634 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:14:19.318634 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:14:19.318634 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 22 11:14:19.318634 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 22 11:14:19.318634 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 32987e25-1c75-405f-b1e5-f152b4f38a7b could not be found. Jul 22 11:14:19.318634 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:14:19.318634 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-b2578c21-b953-4801-8ecb-863e6912b632 tempest-VolumesSnapshotsTestJSON-386867167 tempest-VolumesSnapshotsTestJSON-386867167-project] Returning 404 to user: Volume 32987e25-1c75-405f-b1e5-f152b4f38a7b could not be found. {{(pid=117884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 22 11:14:19.318634 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-b2578c21-b953-4801-8ecb-863e6912b632 tempest-VolumesSnapshotsTestJSON-386867167 tempest-VolumesSnapshotsTestJSON-386867167-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/32987e25-1c75-405f-b1e5-f152b4f38a7b" status: 404 len: 109 microversion: 2.1 time: 0.071877 Jul 22 11:14:19.318634 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 32/49] 10.222.0.20 () {58 vars in 1244 bytes} [Fri Jul 22 11:14:19 2022] GET /compute/v2.1/os-volumes/32987e25-1c75-405f-b1e5-f152b4f38a7b => generated 109 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 22 11:14:19.372489 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-95b39169-80e1-4556-8f50-c0607a5bbc83 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Getting quotas for project f50a15db11214fb5a637fb400dcd928f. Resources: {'instances', 'cores', 'ram'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 22 11:14:19.380896 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-95b39169-80e1-4556-8f50-c0607a5bbc83 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Getting quotas for user da75b78b267f47e8aaaafb41e3acb61a and project f50a15db11214fb5a637fb400dcd928f. Resources: {'instances', 'cores', 'ram'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 22 11:14:19.407408 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-95b39169-80e1-4556-8f50-c0607a5bbc83 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Going to run 1 instances... {{(pid=117885) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 22 11:14:19.421216 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-95b39169-80e1-4556-8f50-c0607a5bbc83 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1a6c3cb4-9f56-44c6-aa68-01000df27209',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 22 11:14:19.548663 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [req-e9bed729-4bcf-4210-a469-81e908c5aa93 req-c8d583d2-ea46-41df-b5f3-2dd02eacb238 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37f3ca38-a4e1-4c99-ace3-be7264f28e4e", "tag": "65b00a5d-a3ec-4ac4-81fb-4c9f29a071f8"}]} {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:14:19.550369 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=14 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:14:19.598928 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-e9bed729-4bcf-4210-a469-81e908c5aa93 req-c8d583d2-ea46-41df-b5f3-2dd02eacb238 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:19.635178 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-e9bed729-4bcf-4210-a469-81e908c5aa93 req-c8d583d2-ea46-41df-b5f3-2dd02eacb238 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:19.654262 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-95b39169-80e1-4556-8f50-c0607a5bbc83 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.465741 Jul 22 11:14:19.657660 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 18/50] 10.222.0.20 () {60 vars in 1146 bytes} [Fri Jul 22 11:14:16 2022] POST /compute/v2.1/servers => generated 401 bytes in 3471 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 22 11:14:19.703927 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-6094ac97-1786-49a6-b2a7-a09d837a34d6 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:19.707733 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-6094ac97-1786-49a6-b2a7-a09d837a34d6 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] [instance: 37f3ca38-a4e1-4c99-ace3-be7264f28e4e] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:19.729810 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6094ac97-1786-49a6-b2a7-a09d837a34d6 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:19.734718 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6094ac97-1786-49a6-b2a7-a09d837a34d6 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:19.742415 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6094ac97-1786-49a6-b2a7-a09d837a34d6 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:19.744959 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6094ac97-1786-49a6-b2a7-a09d837a34d6 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:19.836129 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.compute.server_external_events [req-e9bed729-4bcf-4210-a469-81e908c5aa93 req-c8d583d2-ea46-41df-b5f3-2dd02eacb238 service nova] Creating event network-changed:65b00a5d-a3ec-4ac4-81fb-4c9f29a071f8 for instance 37f3ca38-a4e1-4c99-ace3-be7264f28e4e on hv-cinder-84890 Jul 22 11:14:19.836680 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-e9bed729-4bcf-4210-a469-81e908c5aa93 req-c8d583d2-ea46-41df-b5f3-2dd02eacb238 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117884) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 22 11:14:19.863353 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-b283f2bf-0bf5-450f-b94d-1ffa63973fe5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:19.865269 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-b283f2bf-0bf5-450f-b94d-1ffa63973fe5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:19.866171 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-b283f2bf-0bf5-450f-b94d-1ffa63973fe5 None None] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:19.866613 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-b283f2bf-0bf5-450f-b94d-1ffa63973fe5 None None] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:19.936188 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.compute.rpcapi [None req-b283f2bf-0bf5-450f-b94d-1ffa63973fe5 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 22 11:14:19.940460 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-b283f2bf-0bf5-450f-b94d-1ffa63973fe5 None None] Releasing lock "compute-rpcapi-router" {{(pid=117884) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 22 11:14:19.994631 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-b283f2bf-0bf5-450f-b94d-1ffa63973fe5 None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.678695 Jul 22 11:14:19.995661 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 33/51] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:14:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:14:20.007736 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-18704e2a-0a02-44e9-b6a4-d8591a449de6 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:20.012382 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-18704e2a-0a02-44e9-b6a4-d8591a449de6 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:20.157040 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-18704e2a-0a02-44e9-b6a4-d8591a449de6 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:20.177659 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-18704e2a-0a02-44e9-b6a4-d8591a449de6 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1235 microversion: 2.1 time: 0.175768 Jul 22 11:14:20.193782 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 34/52] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:20 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1235 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:20.199081 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-c92d835f-d1a1-4049-8e8e-bc3233a8a9fb tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:20.199853 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-c92d835f-d1a1-4049-8e8e-bc3233a8a9fb tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 3108d9e0-3b2d-402a-aaab-c313c30e7900] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:20.224036 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c92d835f-d1a1-4049-8e8e-bc3233a8a9fb tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:20.224545 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c92d835f-d1a1-4049-8e8e-bc3233a8a9fb tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:20.225560 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c92d835f-d1a1-4049-8e8e-bc3233a8a9fb tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:20.234126 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c92d835f-d1a1-4049-8e8e-bc3233a8a9fb tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:20.260562 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-6094ac97-1786-49a6-b2a7-a09d837a34d6 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5202e2bdba064c4aaa84e15e1f0f0dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cd35ed100244fdab3228d1afe62400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:20.270603 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-6094ac97-1786-49a6-b2a7-a09d837a34d6 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] 10.222.0.20 "GET /compute/v2.1/servers/37f3ca38-a4e1-4c99-ace3-be7264f28e4e" status: 200 len: 1315 microversion: 2.1 time: 0.608853 Jul 22 11:14:20.274841 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 19/53] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:19 2022] GET /compute/v2.1/servers/37f3ca38-a4e1-4c99-ace3-be7264f28e4e => generated 1315 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:20.285808 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-af0242d9-7901-464b-bc8a-11628b78bedd tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:20.286788 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-af0242d9-7901-464b-bc8a-11628b78bedd tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 0501f722-7553-4cba-9675-7bcbabb72887] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:20.296845 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-af0242d9-7901-464b-bc8a-11628b78bedd tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:20.297723 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-af0242d9-7901-464b-bc8a-11628b78bedd tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:20.299252 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-af0242d9-7901-464b-bc8a-11628b78bedd tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:20.299929 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-af0242d9-7901-464b-bc8a-11628b78bedd tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:20.435199 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-c92d835f-d1a1-4049-8e8e-bc3233a8a9fb tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:20.441615 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-af0242d9-7901-464b-bc8a-11628b78bedd tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:20.455796 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-c92d835f-d1a1-4049-8e8e-bc3233a8a9fb tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900" status: 200 len: 1274 microversion: 2.1 time: 0.257144 Jul 22 11:14:20.456694 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 35/54] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:20 2022] GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900 => generated 1274 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:20.459696 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-af0242d9-7901-464b-bc8a-11628b78bedd tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887" status: 200 len: 1293 microversion: 2.1 time: 0.183028 Jul 22 11:14:20.460300 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 20/55] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:20 2022] GET /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887 => generated 1293 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:21.213488 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-772e08f8-82a9-4e1a-8755-e3592260f81d tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:21.216150 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-772e08f8-82a9-4e1a-8755-e3592260f81d tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:21.233952 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-772e08f8-82a9-4e1a-8755-e3592260f81d tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:21.234973 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-772e08f8-82a9-4e1a-8755-e3592260f81d tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:21.234973 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-772e08f8-82a9-4e1a-8755-e3592260f81d tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:21.236127 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-772e08f8-82a9-4e1a-8755-e3592260f81d tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:21.290395 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-f74d7368-a4d3-439e-993c-0178b1528126 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:21.291093 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-f74d7368-a4d3-439e-993c-0178b1528126 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] [instance: 37f3ca38-a4e1-4c99-ace3-be7264f28e4e] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:21.302709 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f74d7368-a4d3-439e-993c-0178b1528126 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:21.303291 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f74d7368-a4d3-439e-993c-0178b1528126 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:21.305144 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f74d7368-a4d3-439e-993c-0178b1528126 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:21.309002 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f74d7368-a4d3-439e-993c-0178b1528126 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:21.375184 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-772e08f8-82a9-4e1a-8755-e3592260f81d tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:21.388793 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-772e08f8-82a9-4e1a-8755-e3592260f81d tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1239 microversion: 2.1 time: 0.181759 Jul 22 11:14:21.391728 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 36/56] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:21 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1239 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:21.473471 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-b17bd50e-5312-4b51-af94-04af5ff9b1f1 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:21.474135 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-b17bd50e-5312-4b51-af94-04af5ff9b1f1 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 3108d9e0-3b2d-402a-aaab-c313c30e7900] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:21.488551 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-b17bd50e-5312-4b51-af94-04af5ff9b1f1 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:21.489283 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-b17bd50e-5312-4b51-af94-04af5ff9b1f1 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:21.498239 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-b17bd50e-5312-4b51-af94-04af5ff9b1f1 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:21.500227 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-b17bd50e-5312-4b51-af94-04af5ff9b1f1 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:22.260462 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-b17bd50e-5312-4b51-af94-04af5ff9b1f1 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:22.304219 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-b17bd50e-5312-4b51-af94-04af5ff9b1f1 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900" status: 200 len: 1282 microversion: 2.1 time: 0.834715 Jul 22 11:14:22.319984 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 37/57] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:21 2022] GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900 => generated 1282 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:14:22.344726 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-b4591426-a6d6-4da0-9a91-d042a9488a80 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:22.348340 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-b4591426-a6d6-4da0-9a91-d042a9488a80 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 0501f722-7553-4cba-9675-7bcbabb72887] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:22.389965 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-b4591426-a6d6-4da0-9a91-d042a9488a80 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:22.390419 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-b4591426-a6d6-4da0-9a91-d042a9488a80 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:22.392244 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-b4591426-a6d6-4da0-9a91-d042a9488a80 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:22.399189 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-b4591426-a6d6-4da0-9a91-d042a9488a80 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:22.583673 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-f74d7368-a4d3-439e-993c-0178b1528126 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5202e2bdba064c4aaa84e15e1f0f0dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cd35ed100244fdab3228d1afe62400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:22.598994 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-f74d7368-a4d3-439e-993c-0178b1528126 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] 10.222.0.20 "GET /compute/v2.1/servers/37f3ca38-a4e1-4c99-ace3-be7264f28e4e" status: 200 len: 1315 microversion: 2.1 time: 1.313618 Jul 22 11:14:22.600552 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 21/58] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:21 2022] GET /compute/v2.1/servers/37f3ca38-a4e1-4c99-ace3-be7264f28e4e => generated 1315 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:22.605556 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-ec386f85-7d9a-465a-9464-f05da918ae9c tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:22.606423 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-ec386f85-7d9a-465a-9464-f05da918ae9c tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:22.618290 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ec386f85-7d9a-465a-9464-f05da918ae9c tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:22.619138 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ec386f85-7d9a-465a-9464-f05da918ae9c tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:22.620273 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ec386f85-7d9a-465a-9464-f05da918ae9c tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:22.621033 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ec386f85-7d9a-465a-9464-f05da918ae9c tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:23.003752 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-ec386f85-7d9a-465a-9464-f05da918ae9c tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:23.047880 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-ec386f85-7d9a-465a-9464-f05da918ae9c tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1231 microversion: 2.1 time: 0.438683 Jul 22 11:14:23.055395 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 22/59] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:22 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1231 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:23.332634 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-be08d130-e3fe-439a-b2ac-8091aae24f98 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:23.333546 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-be08d130-e3fe-439a-b2ac-8091aae24f98 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 3108d9e0-3b2d-402a-aaab-c313c30e7900] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:23.357046 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-be08d130-e3fe-439a-b2ac-8091aae24f98 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:23.357516 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-be08d130-e3fe-439a-b2ac-8091aae24f98 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:23.358344 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-be08d130-e3fe-439a-b2ac-8091aae24f98 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:23.362838 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-be08d130-e3fe-439a-b2ac-8091aae24f98 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:23.625053 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-be08d130-e3fe-439a-b2ac-8091aae24f98 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:23.648079 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-be08d130-e3fe-439a-b2ac-8091aae24f98 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900" status: 200 len: 1280 microversion: 2.1 time: 0.324946 Jul 22 11:14:23.651112 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 23/60] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:23 2022] GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900 => generated 1280 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:23.665677 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-05c6a610-ea86-48a2-8fa8-b5fd1a05ab66 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:23.666598 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-05c6a610-ea86-48a2-8fa8-b5fd1a05ab66 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] [instance: 37f3ca38-a4e1-4c99-ace3-be7264f28e4e] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:23.681791 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-05c6a610-ea86-48a2-8fa8-b5fd1a05ab66 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:23.682981 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-05c6a610-ea86-48a2-8fa8-b5fd1a05ab66 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:23.686218 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-05c6a610-ea86-48a2-8fa8-b5fd1a05ab66 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:23.686760 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-05c6a610-ea86-48a2-8fa8-b5fd1a05ab66 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:23.914305 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-b4591426-a6d6-4da0-9a91-d042a9488a80 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:23.922284 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-b4591426-a6d6-4da0-9a91-d042a9488a80 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887" status: 200 len: 1293 microversion: 2.1 time: 1.599820 Jul 22 11:14:23.925893 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 38/61] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:22 2022] GET /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887 => generated 1293 bytes in 1609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:24.077355 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-05c6a610-ea86-48a2-8fa8-b5fd1a05ab66 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5202e2bdba064c4aaa84e15e1f0f0dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cd35ed100244fdab3228d1afe62400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:24.080805 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-360e230f-2b2b-473d-8b0c-34624702a576 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:24.081735 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-360e230f-2b2b-473d-8b0c-34624702a576 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:24.097836 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-05c6a610-ea86-48a2-8fa8-b5fd1a05ab66 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] 10.222.0.20 "GET /compute/v2.1/servers/37f3ca38-a4e1-4c99-ace3-be7264f28e4e" status: 200 len: 1315 microversion: 2.1 time: 0.445020 Jul 22 11:14:24.109374 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 24/62] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:23 2022] GET /compute/v2.1/servers/37f3ca38-a4e1-4c99-ace3-be7264f28e4e => generated 1315 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:24.121101 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-360e230f-2b2b-473d-8b0c-34624702a576 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:24.122134 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-360e230f-2b2b-473d-8b0c-34624702a576 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:24.123279 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-360e230f-2b2b-473d-8b0c-34624702a576 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:24.124007 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-360e230f-2b2b-473d-8b0c-34624702a576 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:24.207552 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-360e230f-2b2b-473d-8b0c-34624702a576 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:24.220559 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-360e230f-2b2b-473d-8b0c-34624702a576 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1287 microversion: 2.1 time: 0.144945 Jul 22 11:14:24.222285 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 39/63] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:24 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1287 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:24.668996 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-39d74ead-d9f0-473d-9f98-0b7395c516dc tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:24.669982 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-39d74ead-d9f0-473d-9f98-0b7395c516dc tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 3108d9e0-3b2d-402a-aaab-c313c30e7900] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:24.683445 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-39d74ead-d9f0-473d-9f98-0b7395c516dc tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:24.687522 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-39d74ead-d9f0-473d-9f98-0b7395c516dc tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:24.690503 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-39d74ead-d9f0-473d-9f98-0b7395c516dc tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:24.691401 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-39d74ead-d9f0-473d-9f98-0b7395c516dc tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:24.943099 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-f574488d-f0dc-40e4-8add-361e5b313bf1 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:24.947901 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-f574488d-f0dc-40e4-8add-361e5b313bf1 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 0501f722-7553-4cba-9675-7bcbabb72887] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:24.959461 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f574488d-f0dc-40e4-8add-361e5b313bf1 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:24.968571 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f574488d-f0dc-40e4-8add-361e5b313bf1 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:24.973377 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f574488d-f0dc-40e4-8add-361e5b313bf1 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:24.975829 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f574488d-f0dc-40e4-8add-361e5b313bf1 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:25.032708 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-39d74ead-d9f0-473d-9f98-0b7395c516dc tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:25.056745 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-39d74ead-d9f0-473d-9f98-0b7395c516dc tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900" status: 200 len: 1322 microversion: 2.1 time: 0.389266 Jul 22 11:14:25.061436 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 25/64] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:24 2022] GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900 => generated 1322 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:25.119287 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-b1a76a2b-110b-4776-859b-79da58f438e5 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:25.120120 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-b1a76a2b-110b-4776-859b-79da58f438e5 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] [instance: 37f3ca38-a4e1-4c99-ace3-be7264f28e4e] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:25.130202 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b1a76a2b-110b-4776-859b-79da58f438e5 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:25.130920 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b1a76a2b-110b-4776-859b-79da58f438e5 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:25.132453 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b1a76a2b-110b-4776-859b-79da58f438e5 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:25.133340 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b1a76a2b-110b-4776-859b-79da58f438e5 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:25.164443 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-f574488d-f0dc-40e4-8add-361e5b313bf1 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:25.185926 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-f574488d-f0dc-40e4-8add-361e5b313bf1 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887" status: 200 len: 1299 microversion: 2.1 time: 0.247534 Jul 22 11:14:25.196349 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 40/65] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:24 2022] GET /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887 => generated 1299 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:14:25.240718 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-a8925d5d-55bd-481c-b672-9678c24cdf14 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:25.241337 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-a8925d5d-55bd-481c-b672-9678c24cdf14 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:25.251945 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-a8925d5d-55bd-481c-b672-9678c24cdf14 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:25.259391 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-a8925d5d-55bd-481c-b672-9678c24cdf14 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:25.263767 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-a8925d5d-55bd-481c-b672-9678c24cdf14 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:25.264218 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-a8925d5d-55bd-481c-b672-9678c24cdf14 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:25.367495 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-b1a76a2b-110b-4776-859b-79da58f438e5 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5202e2bdba064c4aaa84e15e1f0f0dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cd35ed100244fdab3228d1afe62400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:25.377775 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-b1a76a2b-110b-4776-859b-79da58f438e5 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] 10.222.0.20 "GET /compute/v2.1/servers/37f3ca38-a4e1-4c99-ace3-be7264f28e4e" status: 200 len: 1315 microversion: 2.1 time: 0.262825 Jul 22 11:14:25.390480 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 26/66] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:25 2022] GET /compute/v2.1/servers/37f3ca38-a4e1-4c99-ace3-be7264f28e4e => generated 1315 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:25.398904 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-a8925d5d-55bd-481c-b672-9678c24cdf14 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:25.408753 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-a8925d5d-55bd-481c-b672-9678c24cdf14 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1287 microversion: 2.1 time: 0.173536 Jul 22 11:14:25.419587 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 41/67] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:25 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1287 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:14:25.560609 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-5b4bedcd-320c-49da-aa38-18eb7d513fe4 req-ded8295f-9c65-4a95-8540-c1e01f9eab8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbf8cb41-3496-45fe-9392-6add8f6873d0", "tag": "6c864331-87d8-4526-8824-f0d87403783e"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:14:25.573088 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-5b4bedcd-320c-49da-aa38-18eb7d513fe4 req-ded8295f-9c65-4a95-8540-c1e01f9eab8a service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:25.573539 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-5b4bedcd-320c-49da-aa38-18eb7d513fe4 req-ded8295f-9c65-4a95-8540-c1e01f9eab8a service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:25.601952 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-5b4bedcd-320c-49da-aa38-18eb7d513fe4 req-ded8295f-9c65-4a95-8540-c1e01f9eab8a service nova] Creating event network-changed:6c864331-87d8-4526-8824-f0d87403783e for instance fbf8cb41-3496-45fe-9392-6add8f6873d0 on hv-cinder-84890 Jul 22 11:14:25.602852 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-5b4bedcd-320c-49da-aa38-18eb7d513fe4 req-ded8295f-9c65-4a95-8540-c1e01f9eab8a service nova] Acquired lock "compute-rpcapi-router" {{(pid=117885) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 22 11:14:25.604956 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-911f7214-2ab8-4e56-83fa-3ae78ed6b76e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:25.605264 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-911f7214-2ab8-4e56-83fa-3ae78ed6b76e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:25.606580 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-911f7214-2ab8-4e56-83fa-3ae78ed6b76e None None] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:25.608195 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-911f7214-2ab8-4e56-83fa-3ae78ed6b76e None None] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:25.618696 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.compute.rpcapi [None req-911f7214-2ab8-4e56-83fa-3ae78ed6b76e None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 22 11:14:25.619680 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-911f7214-2ab8-4e56-83fa-3ae78ed6b76e None None] Releasing lock "compute-rpcapi-router" {{(pid=117885) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 22 11:14:25.636210 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-911f7214-2ab8-4e56-83fa-3ae78ed6b76e None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145704 Jul 22 11:14:25.636839 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 27/68] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:14:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:14:26.081772 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-f4babf8d-cc42-4405-9ea8-37ffd2e9acd6 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:26.083388 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-f4babf8d-cc42-4405-9ea8-37ffd2e9acd6 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 3108d9e0-3b2d-402a-aaab-c313c30e7900] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:26.087128 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG dbcounter [-] [117884] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=3 {{(pid=117884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:14:26.096147 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f4babf8d-cc42-4405-9ea8-37ffd2e9acd6 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:26.096598 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f4babf8d-cc42-4405-9ea8-37ffd2e9acd6 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:26.097408 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f4babf8d-cc42-4405-9ea8-37ffd2e9acd6 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:26.097874 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f4babf8d-cc42-4405-9ea8-37ffd2e9acd6 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:26.119603 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG dbcounter [-] [117884] Writing DB stats nova_cell1:SELECT=100 {{(pid=117884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:14:26.212597 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-a59baa60-c251-4e3e-a13d-c18ab41e4cba tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:26.213463 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-a59baa60-c251-4e3e-a13d-c18ab41e4cba tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 0501f722-7553-4cba-9675-7bcbabb72887] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:26.233785 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a59baa60-c251-4e3e-a13d-c18ab41e4cba tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:26.237000 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a59baa60-c251-4e3e-a13d-c18ab41e4cba tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:26.241574 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a59baa60-c251-4e3e-a13d-c18ab41e4cba tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:26.243084 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a59baa60-c251-4e3e-a13d-c18ab41e4cba tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:26.291085 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-f4babf8d-cc42-4405-9ea8-37ffd2e9acd6 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:26.306167 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-f4babf8d-cc42-4405-9ea8-37ffd2e9acd6 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900" status: 200 len: 1322 microversion: 2.1 time: 0.234535 Jul 22 11:14:26.307033 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 42/69] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:26 2022] GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900 => generated 1322 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:26.329988 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-a59baa60-c251-4e3e-a13d-c18ab41e4cba tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:26.342256 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-a59baa60-c251-4e3e-a13d-c18ab41e4cba tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887" status: 200 len: 1299 microversion: 2.1 time: 0.133923 Jul 22 11:14:26.342871 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 28/70] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:26 2022] GET /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887 => generated 1299 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:26.399376 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-c88deb41-1c55-4a51-933f-1b738f8e1099 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:26.400464 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-c88deb41-1c55-4a51-933f-1b738f8e1099 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] [instance: 37f3ca38-a4e1-4c99-ace3-be7264f28e4e] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:26.410351 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c88deb41-1c55-4a51-933f-1b738f8e1099 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:26.411069 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c88deb41-1c55-4a51-933f-1b738f8e1099 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:26.412943 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c88deb41-1c55-4a51-933f-1b738f8e1099 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:26.413826 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c88deb41-1c55-4a51-933f-1b738f8e1099 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:26.430106 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-f87a1d05-1cfc-4a96-b34f-8ea5c93f8913 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:26.430933 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-f87a1d05-1cfc-4a96-b34f-8ea5c93f8913 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:26.441267 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f87a1d05-1cfc-4a96-b34f-8ea5c93f8913 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:26.442043 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f87a1d05-1cfc-4a96-b34f-8ea5c93f8913 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:26.442888 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f87a1d05-1cfc-4a96-b34f-8ea5c93f8913 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:26.443710 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f87a1d05-1cfc-4a96-b34f-8ea5c93f8913 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:26.535302 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-f87a1d05-1cfc-4a96-b34f-8ea5c93f8913 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:26.551431 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-f87a1d05-1cfc-4a96-b34f-8ea5c93f8913 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1287 microversion: 2.1 time: 0.127683 Jul 22 11:14:26.553076 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 29/71] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:26 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1287 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:26.632020 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-c88deb41-1c55-4a51-933f-1b738f8e1099 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5202e2bdba064c4aaa84e15e1f0f0dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cd35ed100244fdab3228d1afe62400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:26.642491 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-c88deb41-1c55-4a51-933f-1b738f8e1099 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] 10.222.0.20 "GET /compute/v2.1/servers/37f3ca38-a4e1-4c99-ace3-be7264f28e4e" status: 200 len: 1315 microversion: 2.1 time: 0.250727 Jul 22 11:14:26.643484 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 43/72] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:26 2022] GET /compute/v2.1/servers/37f3ca38-a4e1-4c99-ace3-be7264f28e4e => generated 1315 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:27.333387 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-f63f1aae-11b3-444f-973a-fd222dba6cd4 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:27.334533 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-f63f1aae-11b3-444f-973a-fd222dba6cd4 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 3108d9e0-3b2d-402a-aaab-c313c30e7900] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:27.357076 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f63f1aae-11b3-444f-973a-fd222dba6cd4 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:27.357537 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f63f1aae-11b3-444f-973a-fd222dba6cd4 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:27.360232 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f63f1aae-11b3-444f-973a-fd222dba6cd4 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:27.360232 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f63f1aae-11b3-444f-973a-fd222dba6cd4 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:27.367443 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-b58be780-3c0e-423c-903b-de66d8dfaeb0 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:27.368818 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-b58be780-3c0e-423c-903b-de66d8dfaeb0 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 0501f722-7553-4cba-9675-7bcbabb72887] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:27.383428 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-b58be780-3c0e-423c-903b-de66d8dfaeb0 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:27.391540 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-b58be780-3c0e-423c-903b-de66d8dfaeb0 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:27.393956 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-b58be780-3c0e-423c-903b-de66d8dfaeb0 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:27.395968 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-b58be780-3c0e-423c-903b-de66d8dfaeb0 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:27.561136 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-b58be780-3c0e-423c-903b-de66d8dfaeb0 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:27.588302 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-b58be780-3c0e-423c-903b-de66d8dfaeb0 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887" status: 200 len: 1299 microversion: 2.1 time: 0.223991 Jul 22 11:14:27.590718 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 44/73] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:27 2022] GET /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887 => generated 1299 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:27.619952 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-6f660489-5c10-4445-84ba-efcbedcf4822 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:27.632119 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-6f660489-5c10-4445-84ba-efcbedcf4822 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:27.698038 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-6f660489-5c10-4445-84ba-efcbedcf4822 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:27.700368 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-6f660489-5c10-4445-84ba-efcbedcf4822 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:27.707342 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-6f660489-5c10-4445-84ba-efcbedcf4822 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:27.709253 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-6f660489-5c10-4445-84ba-efcbedcf4822 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:27.841307 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-f63f1aae-11b3-444f-973a-fd222dba6cd4 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:27.867817 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-f63f1aae-11b3-444f-973a-fd222dba6cd4 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900" status: 200 len: 1322 microversion: 2.1 time: 0.538494 Jul 22 11:14:27.885411 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 30/74] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:27 2022] GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900 => generated 1322 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:27.904028 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-cdd65e5a-051a-405b-9bd1-ec11a142a398 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:27.906827 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-cdd65e5a-051a-405b-9bd1-ec11a142a398 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] [instance: 37f3ca38-a4e1-4c99-ace3-be7264f28e4e] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:27.919743 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-6f660489-5c10-4445-84ba-efcbedcf4822 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:27.927517 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-cdd65e5a-051a-405b-9bd1-ec11a142a398 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:27.928606 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-cdd65e5a-051a-405b-9bd1-ec11a142a398 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:27.931035 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-cdd65e5a-051a-405b-9bd1-ec11a142a398 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:27.932410 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-cdd65e5a-051a-405b-9bd1-ec11a142a398 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:27.947819 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-6f660489-5c10-4445-84ba-efcbedcf4822 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1287 microversion: 2.1 time: 0.350436 Jul 22 11:14:27.957176 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 45/75] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:27 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1287 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:28.010129 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=100 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:14:28.310455 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-cdd65e5a-051a-405b-9bd1-ec11a142a398 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5202e2bdba064c4aaa84e15e1f0f0dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cd35ed100244fdab3228d1afe62400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:28.322842 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-cdd65e5a-051a-405b-9bd1-ec11a142a398 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] 10.222.0.20 "GET /compute/v2.1/servers/37f3ca38-a4e1-4c99-ace3-be7264f28e4e" status: 200 len: 1315 microversion: 2.1 time: 0.431595 Jul 22 11:14:28.323541 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 31/76] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:27 2022] GET /compute/v2.1/servers/37f3ca38-a4e1-4c99-ace3-be7264f28e4e => generated 1315 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:28.619185 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-7c2380db-9580-4576-aca6-de9c6499917d tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:28.619853 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-7c2380db-9580-4576-aca6-de9c6499917d tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 0501f722-7553-4cba-9675-7bcbabb72887] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:28.633873 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-7c2380db-9580-4576-aca6-de9c6499917d tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:28.634057 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-7c2380db-9580-4576-aca6-de9c6499917d tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:28.635120 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-7c2380db-9580-4576-aca6-de9c6499917d tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:28.635948 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-7c2380db-9580-4576-aca6-de9c6499917d tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:28.759483 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-7c2380db-9580-4576-aca6-de9c6499917d tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:28.769805 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-7c2380db-9580-4576-aca6-de9c6499917d tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887" status: 200 len: 1299 microversion: 2.1 time: 0.154291 Jul 22 11:14:28.770618 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 46/77] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:28 2022] GET /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887 => generated 1299 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:28.899686 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-20e721b2-e7c2-432b-a549-7ab6f96a5acb tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:28.901393 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-20e721b2-e7c2-432b-a549-7ab6f96a5acb tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 3108d9e0-3b2d-402a-aaab-c313c30e7900] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:28.910080 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-20e721b2-e7c2-432b-a549-7ab6f96a5acb tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:28.910952 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-20e721b2-e7c2-432b-a549-7ab6f96a5acb tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:28.912086 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-20e721b2-e7c2-432b-a549-7ab6f96a5acb tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:28.912825 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-20e721b2-e7c2-432b-a549-7ab6f96a5acb tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:28.965696 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-918516ee-20bf-459e-ad88-28bd86d5464a tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:28.966308 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-918516ee-20bf-459e-ad88-28bd86d5464a tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:28.994503 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-918516ee-20bf-459e-ad88-28bd86d5464a tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:28.994962 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-918516ee-20bf-459e-ad88-28bd86d5464a tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:29.000583 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-918516ee-20bf-459e-ad88-28bd86d5464a tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:29.005614 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-918516ee-20bf-459e-ad88-28bd86d5464a tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:29.181274 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-918516ee-20bf-459e-ad88-28bd86d5464a tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:29.191438 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-918516ee-20bf-459e-ad88-28bd86d5464a tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1287 microversion: 2.1 time: 0.230490 Jul 22 11:14:29.209865 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 47/78] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:28 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1287 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:29.329310 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-20e721b2-e7c2-432b-a549-7ab6f96a5acb tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:29.342067 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-483f95af-f77f-46da-8c48-3c27fab9fa0c tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:29.343042 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-483f95af-f77f-46da-8c48-3c27fab9fa0c tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] [instance: 37f3ca38-a4e1-4c99-ace3-be7264f28e4e] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:29.351024 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-483f95af-f77f-46da-8c48-3c27fab9fa0c tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:29.351860 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-483f95af-f77f-46da-8c48-3c27fab9fa0c tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:29.352966 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-483f95af-f77f-46da-8c48-3c27fab9fa0c tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:29.353761 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-483f95af-f77f-46da-8c48-3c27fab9fa0c tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:29.357529 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-20e721b2-e7c2-432b-a549-7ab6f96a5acb tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900" status: 200 len: 1322 microversion: 2.1 time: 0.461708 Jul 22 11:14:29.362838 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 32/79] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:28 2022] GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900 => generated 1322 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:29.697579 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-483f95af-f77f-46da-8c48-3c27fab9fa0c tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5202e2bdba064c4aaa84e15e1f0f0dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cd35ed100244fdab3228d1afe62400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:29.707576 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-483f95af-f77f-46da-8c48-3c27fab9fa0c tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] 10.222.0.20 "GET /compute/v2.1/servers/37f3ca38-a4e1-4c99-ace3-be7264f28e4e" status: 200 len: 1315 microversion: 2.1 time: 0.369209 Jul 22 11:14:29.708205 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 48/80] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:29 2022] GET /compute/v2.1/servers/37f3ca38-a4e1-4c99-ace3-be7264f28e4e => generated 1315 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:29.788512 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-6e201d24-302c-41af-ad07-9e9b64daf8b9 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:29.789259 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-6e201d24-302c-41af-ad07-9e9b64daf8b9 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 0501f722-7553-4cba-9675-7bcbabb72887] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:29.791654 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell0:SELECT=34 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:14:29.797038 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6e201d24-302c-41af-ad07-9e9b64daf8b9 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:29.797506 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6e201d24-302c-41af-ad07-9e9b64daf8b9 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:29.798338 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6e201d24-302c-41af-ad07-9e9b64daf8b9 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:29.798820 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6e201d24-302c-41af-ad07-9e9b64daf8b9 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:30.059522 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-6e201d24-302c-41af-ad07-9e9b64daf8b9 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:30.076780 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-6e201d24-302c-41af-ad07-9e9b64daf8b9 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887" status: 200 len: 1299 microversion: 2.1 time: 0.291643 Jul 22 11:14:30.095098 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 33/81] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:29 2022] GET /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887 => generated 1299 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:30.208900 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-44fc58ff-9657-4c61-bef9-d15167c86e75 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:30.210236 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-44fc58ff-9657-4c61-bef9-d15167c86e75 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:30.212275 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG dbcounter [-] [117884] Writing DB stats nova_cell0:SELECT=4 {{(pid=117884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:14:30.212927 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG dbcounter [-] [117884] Writing DB stats nova_cell0:SELECT=16 {{(pid=117884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:14:30.221320 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-44fc58ff-9657-4c61-bef9-d15167c86e75 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:30.221759 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-44fc58ff-9657-4c61-bef9-d15167c86e75 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:30.222529 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-44fc58ff-9657-4c61-bef9-d15167c86e75 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:30.222959 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-44fc58ff-9657-4c61-bef9-d15167c86e75 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:30.302871 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-44fc58ff-9657-4c61-bef9-d15167c86e75 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:30.311338 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-44fc58ff-9657-4c61-bef9-d15167c86e75 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1287 microversion: 2.1 time: 0.106104 Jul 22 11:14:30.312510 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 49/82] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:30 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1287 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:14:30.380809 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-f672bde2-157f-48b5-a17f-d7065c3cc7fa tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:30.381657 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-f672bde2-157f-48b5-a17f-d7065c3cc7fa tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 3108d9e0-3b2d-402a-aaab-c313c30e7900] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:30.392772 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f672bde2-157f-48b5-a17f-d7065c3cc7fa tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:30.393694 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f672bde2-157f-48b5-a17f-d7065c3cc7fa tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:30.394888 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f672bde2-157f-48b5-a17f-d7065c3cc7fa tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:30.395352 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f672bde2-157f-48b5-a17f-d7065c3cc7fa tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:30.556766 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-f672bde2-157f-48b5-a17f-d7065c3cc7fa tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:30.565810 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-f672bde2-157f-48b5-a17f-d7065c3cc7fa tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900" status: 200 len: 1322 microversion: 2.1 time: 0.189206 Jul 22 11:14:30.566520 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 34/83] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:30 2022] GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900 => generated 1322 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:30.727036 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-e71fe05b-37f8-48cb-907b-fa6e06a88482 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:30.728747 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-e71fe05b-37f8-48cb-907b-fa6e06a88482 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] [instance: 37f3ca38-a4e1-4c99-ace3-be7264f28e4e] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:30.740450 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-e71fe05b-37f8-48cb-907b-fa6e06a88482 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:30.741184 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-e71fe05b-37f8-48cb-907b-fa6e06a88482 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:30.742038 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-e71fe05b-37f8-48cb-907b-fa6e06a88482 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:30.742637 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-e71fe05b-37f8-48cb-907b-fa6e06a88482 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:30.991854 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-e71fe05b-37f8-48cb-907b-fa6e06a88482 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5202e2bdba064c4aaa84e15e1f0f0dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cd35ed100244fdab3228d1afe62400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:31.010500 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-e71fe05b-37f8-48cb-907b-fa6e06a88482 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] 10.222.0.20 "GET /compute/v2.1/servers/37f3ca38-a4e1-4c99-ace3-be7264f28e4e" status: 200 len: 1315 microversion: 2.1 time: 0.288097 Jul 22 11:14:31.026081 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 50/84] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:30 2022] GET /compute/v2.1/servers/37f3ca38-a4e1-4c99-ace3-be7264f28e4e => generated 1315 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:14:31.104793 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-4f533a63-6c8b-4480-bbc1-2171ac4d1172 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:31.106029 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-4f533a63-6c8b-4480-bbc1-2171ac4d1172 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 0501f722-7553-4cba-9675-7bcbabb72887] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:31.118881 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4f533a63-6c8b-4480-bbc1-2171ac4d1172 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:31.121046 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4f533a63-6c8b-4480-bbc1-2171ac4d1172 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:31.123016 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4f533a63-6c8b-4480-bbc1-2171ac4d1172 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:31.124414 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4f533a63-6c8b-4480-bbc1-2171ac4d1172 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:31.231784 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-4f533a63-6c8b-4480-bbc1-2171ac4d1172 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:31.247087 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-4f533a63-6c8b-4480-bbc1-2171ac4d1172 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887" status: 200 len: 1299 microversion: 2.1 time: 0.147810 Jul 22 11:14:31.249508 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 35/85] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:31 2022] GET /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887 => generated 1299 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:31.334492 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-266373fc-d8be-4800-a00f-890cfe0167d9 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:31.335420 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-266373fc-d8be-4800-a00f-890cfe0167d9 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:31.344367 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-266373fc-d8be-4800-a00f-890cfe0167d9 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:31.346179 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-266373fc-d8be-4800-a00f-890cfe0167d9 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:31.348076 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-266373fc-d8be-4800-a00f-890cfe0167d9 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:31.349192 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-266373fc-d8be-4800-a00f-890cfe0167d9 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:31.445278 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-266373fc-d8be-4800-a00f-890cfe0167d9 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:31.457695 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-266373fc-d8be-4800-a00f-890cfe0167d9 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1287 microversion: 2.1 time: 0.129773 Jul 22 11:14:31.463729 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 51/86] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:31 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1287 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:31.590580 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-0ea09117-14a4-43f4-9ef8-a278644a321a tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:31.592312 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-0ea09117-14a4-43f4-9ef8-a278644a321a tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 3108d9e0-3b2d-402a-aaab-c313c30e7900] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:31.610803 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0ea09117-14a4-43f4-9ef8-a278644a321a tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:31.610803 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0ea09117-14a4-43f4-9ef8-a278644a321a tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:31.610803 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0ea09117-14a4-43f4-9ef8-a278644a321a tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:31.610803 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0ea09117-14a4-43f4-9ef8-a278644a321a tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:31.843282 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-0ea09117-14a4-43f4-9ef8-a278644a321a tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:31.854527 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-0ea09117-14a4-43f4-9ef8-a278644a321a tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900" status: 200 len: 1322 microversion: 2.1 time: 0.271882 Jul 22 11:14:31.855304 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 36/87] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:31 2022] GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900 => generated 1322 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:32.035146 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-6816b887-4209-41b2-9a4a-8ec2b0e28f0e tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:32.038535 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-6816b887-4209-41b2-9a4a-8ec2b0e28f0e tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] [instance: 37f3ca38-a4e1-4c99-ace3-be7264f28e4e] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:32.042931 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-6816b887-4209-41b2-9a4a-8ec2b0e28f0e tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:32.043507 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-6816b887-4209-41b2-9a4a-8ec2b0e28f0e tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:32.044671 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-6816b887-4209-41b2-9a4a-8ec2b0e28f0e tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:32.045189 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-6816b887-4209-41b2-9a4a-8ec2b0e28f0e tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:32.266993 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-876c96f9-e4cd-44c8-a0fa-84eb7c6b7413 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:32.267739 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-876c96f9-e4cd-44c8-a0fa-84eb7c6b7413 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 0501f722-7553-4cba-9675-7bcbabb72887] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:32.274839 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-876c96f9-e4cd-44c8-a0fa-84eb7c6b7413 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:32.275434 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-876c96f9-e4cd-44c8-a0fa-84eb7c6b7413 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:32.276289 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-876c96f9-e4cd-44c8-a0fa-84eb7c6b7413 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:32.276789 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-876c96f9-e4cd-44c8-a0fa-84eb7c6b7413 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:32.305217 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-6816b887-4209-41b2-9a4a-8ec2b0e28f0e tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5202e2bdba064c4aaa84e15e1f0f0dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cd35ed100244fdab3228d1afe62400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:32.320441 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-6816b887-4209-41b2-9a4a-8ec2b0e28f0e tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] 10.222.0.20 "GET /compute/v2.1/servers/37f3ca38-a4e1-4c99-ace3-be7264f28e4e" status: 200 len: 1315 microversion: 2.1 time: 0.291351 Jul 22 11:14:32.330706 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 52/88] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:32 2022] GET /compute/v2.1/servers/37f3ca38-a4e1-4c99-ace3-be7264f28e4e => generated 1315 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:32.380248 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-876c96f9-e4cd-44c8-a0fa-84eb7c6b7413 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:32.393450 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-876c96f9-e4cd-44c8-a0fa-84eb7c6b7413 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887" status: 200 len: 1299 microversion: 2.1 time: 0.131032 Jul 22 11:14:32.394667 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 37/89] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:32 2022] GET /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887 => generated 1299 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:14:32.482509 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-91e7a544-9718-4d56-a4a1-e07548d96259 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:32.483130 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-91e7a544-9718-4d56-a4a1-e07548d96259 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:32.490313 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-91e7a544-9718-4d56-a4a1-e07548d96259 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:32.490763 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-91e7a544-9718-4d56-a4a1-e07548d96259 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:32.491597 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-91e7a544-9718-4d56-a4a1-e07548d96259 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:32.492028 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-91e7a544-9718-4d56-a4a1-e07548d96259 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:32.572007 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-91e7a544-9718-4d56-a4a1-e07548d96259 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:32.581480 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-91e7a544-9718-4d56-a4a1-e07548d96259 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1287 microversion: 2.1 time: 0.102774 Jul 22 11:14:32.582080 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 53/90] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:32 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1287 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:32.884822 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-2b56ef73-6f29-481e-90ab-5126c1c02d7c tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:32.886277 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-2b56ef73-6f29-481e-90ab-5126c1c02d7c tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 3108d9e0-3b2d-402a-aaab-c313c30e7900] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:32.895779 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2b56ef73-6f29-481e-90ab-5126c1c02d7c tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:32.896651 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2b56ef73-6f29-481e-90ab-5126c1c02d7c tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:32.897846 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2b56ef73-6f29-481e-90ab-5126c1c02d7c tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:32.898667 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2b56ef73-6f29-481e-90ab-5126c1c02d7c tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:33.104823 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-2b56ef73-6f29-481e-90ab-5126c1c02d7c tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:33.114859 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-2b56ef73-6f29-481e-90ab-5126c1c02d7c tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900" status: 200 len: 1322 microversion: 2.1 time: 0.235790 Jul 22 11:14:33.115606 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 38/91] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:32 2022] GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900 => generated 1322 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:33.337917 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-e1d57d47-c564-44dc-849b-d48cc86d8f22 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:33.338539 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-e1d57d47-c564-44dc-849b-d48cc86d8f22 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] [instance: 37f3ca38-a4e1-4c99-ace3-be7264f28e4e] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:33.344940 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-e1d57d47-c564-44dc-849b-d48cc86d8f22 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:33.345879 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-e1d57d47-c564-44dc-849b-d48cc86d8f22 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:33.346758 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-e1d57d47-c564-44dc-849b-d48cc86d8f22 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:33.347197 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-e1d57d47-c564-44dc-849b-d48cc86d8f22 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:33.422915 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-3a821516-24e2-4d15-ad87-b5b242ba307c tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:33.424246 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-3a821516-24e2-4d15-ad87-b5b242ba307c tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 0501f722-7553-4cba-9675-7bcbabb72887] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:33.440411 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3a821516-24e2-4d15-ad87-b5b242ba307c tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:33.441265 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3a821516-24e2-4d15-ad87-b5b242ba307c tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:33.442677 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3a821516-24e2-4d15-ad87-b5b242ba307c tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:33.444390 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3a821516-24e2-4d15-ad87-b5b242ba307c tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:33.521493 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-e1d57d47-c564-44dc-849b-d48cc86d8f22 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5202e2bdba064c4aaa84e15e1f0f0dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cd35ed100244fdab3228d1afe62400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:33.522425 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-3a821516-24e2-4d15-ad87-b5b242ba307c tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:33.532293 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-3a821516-24e2-4d15-ad87-b5b242ba307c tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887" status: 200 len: 1299 microversion: 2.1 time: 0.118151 Jul 22 11:14:33.533655 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-e1d57d47-c564-44dc-849b-d48cc86d8f22 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] 10.222.0.20 "GET /compute/v2.1/servers/37f3ca38-a4e1-4c99-ace3-be7264f28e4e" status: 200 len: 1315 microversion: 2.1 time: 0.198665 Jul 22 11:14:33.533889 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 39/92] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:33 2022] GET /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887 => generated 1299 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:33.534831 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 54/93] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:33 2022] GET /compute/v2.1/servers/37f3ca38-a4e1-4c99-ace3-be7264f28e4e => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:33.606385 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-74f6e018-1166-4f28-b611-7df5ae4ca554 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:33.608266 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-74f6e018-1166-4f28-b611-7df5ae4ca554 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:33.618405 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-74f6e018-1166-4f28-b611-7df5ae4ca554 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:33.618624 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-74f6e018-1166-4f28-b611-7df5ae4ca554 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:33.619435 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-74f6e018-1166-4f28-b611-7df5ae4ca554 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:33.620388 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-74f6e018-1166-4f28-b611-7df5ae4ca554 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:33.716534 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-74f6e018-1166-4f28-b611-7df5ae4ca554 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:33.731436 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-74f6e018-1166-4f28-b611-7df5ae4ca554 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1287 microversion: 2.1 time: 0.134175 Jul 22 11:14:33.732206 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 40/94] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:33 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1287 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:34.145087 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-d7d0b404-e921-4efc-83ac-beff362d47dc tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:34.146415 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-d7d0b404-e921-4efc-83ac-beff362d47dc tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 3108d9e0-3b2d-402a-aaab-c313c30e7900] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:34.154132 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-d7d0b404-e921-4efc-83ac-beff362d47dc tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:34.154583 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-d7d0b404-e921-4efc-83ac-beff362d47dc tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:34.155385 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-d7d0b404-e921-4efc-83ac-beff362d47dc tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:34.155812 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-d7d0b404-e921-4efc-83ac-beff362d47dc tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:34.310665 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-d7d0b404-e921-4efc-83ac-beff362d47dc tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:34.319901 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-d7d0b404-e921-4efc-83ac-beff362d47dc tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900" status: 200 len: 1322 microversion: 2.1 time: 0.184629 Jul 22 11:14:34.320846 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 55/95] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:34 2022] GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900 => generated 1322 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:34.553086 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-e71b7a7f-a809-4511-9327-172fb53d42dc tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:34.553912 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-e71b7a7f-a809-4511-9327-172fb53d42dc tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] [instance: 37f3ca38-a4e1-4c99-ace3-be7264f28e4e] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:34.561117 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e71b7a7f-a809-4511-9327-172fb53d42dc tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:34.561526 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e71b7a7f-a809-4511-9327-172fb53d42dc tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:34.562574 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e71b7a7f-a809-4511-9327-172fb53d42dc tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:34.563027 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-5706a7c2-ca01-4882-9415-ff8b7ae29087 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:34.563818 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e71b7a7f-a809-4511-9327-172fb53d42dc tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:34.564506 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-5706a7c2-ca01-4882-9415-ff8b7ae29087 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 0501f722-7553-4cba-9675-7bcbabb72887] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:34.572118 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-5706a7c2-ca01-4882-9415-ff8b7ae29087 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:34.572569 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-5706a7c2-ca01-4882-9415-ff8b7ae29087 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:34.573541 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-5706a7c2-ca01-4882-9415-ff8b7ae29087 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:34.574163 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-5706a7c2-ca01-4882-9415-ff8b7ae29087 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:34.645258 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-5706a7c2-ca01-4882-9415-ff8b7ae29087 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:34.666693 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-5706a7c2-ca01-4882-9415-ff8b7ae29087 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887" status: 200 len: 1299 microversion: 2.1 time: 0.110088 Jul 22 11:14:34.668479 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 56/96] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:34 2022] GET /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887 => generated 1299 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:34.747113 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-e71b7a7f-a809-4511-9327-172fb53d42dc tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5202e2bdba064c4aaa84e15e1f0f0dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cd35ed100244fdab3228d1afe62400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:34.749812 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-a8fe20e4-2d9f-41b9-af5e-2061a9649fcb tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:34.750613 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-a8fe20e4-2d9f-41b9-af5e-2061a9649fcb tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:34.755878 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-e71b7a7f-a809-4511-9327-172fb53d42dc tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] 10.222.0.20 "GET /compute/v2.1/servers/37f3ca38-a4e1-4c99-ace3-be7264f28e4e" status: 200 len: 1315 microversion: 2.1 time: 0.207222 Jul 22 11:14:34.756866 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 41/97] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:34 2022] GET /compute/v2.1/servers/37f3ca38-a4e1-4c99-ace3-be7264f28e4e => generated 1315 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:34.758020 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-a8fe20e4-2d9f-41b9-af5e-2061a9649fcb tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:34.758725 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-a8fe20e4-2d9f-41b9-af5e-2061a9649fcb tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:34.759572 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-a8fe20e4-2d9f-41b9-af5e-2061a9649fcb tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:34.760010 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-a8fe20e4-2d9f-41b9-af5e-2061a9649fcb tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:34.846499 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-a8fe20e4-2d9f-41b9-af5e-2061a9649fcb tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:34.854460 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-a8fe20e4-2d9f-41b9-af5e-2061a9649fcb tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1287 microversion: 2.1 time: 0.108520 Jul 22 11:14:34.855096 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 57/98] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:34 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1287 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:14:35.336886 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-0e4bcfdb-4cae-4560-967b-fb2e3341cc23 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:35.337575 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-0e4bcfdb-4cae-4560-967b-fb2e3341cc23 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 3108d9e0-3b2d-402a-aaab-c313c30e7900] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:35.344144 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0e4bcfdb-4cae-4560-967b-fb2e3341cc23 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:35.344607 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0e4bcfdb-4cae-4560-967b-fb2e3341cc23 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:35.346033 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0e4bcfdb-4cae-4560-967b-fb2e3341cc23 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:35.346407 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0e4bcfdb-4cae-4560-967b-fb2e3341cc23 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:35.510666 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-0e4bcfdb-4cae-4560-967b-fb2e3341cc23 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:35.520312 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-0e4bcfdb-4cae-4560-967b-fb2e3341cc23 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900" status: 200 len: 1322 microversion: 2.1 time: 0.187332 Jul 22 11:14:35.521174 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 42/99] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:35 2022] GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900 => generated 1322 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:35.685684 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-2f7fd490-f4ac-4320-8dec-2607b6acf3ff tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:35.686286 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-2f7fd490-f4ac-4320-8dec-2607b6acf3ff tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 0501f722-7553-4cba-9675-7bcbabb72887] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:35.693602 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-2f7fd490-f4ac-4320-8dec-2607b6acf3ff tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:35.694044 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-2f7fd490-f4ac-4320-8dec-2607b6acf3ff tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:35.694817 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-2f7fd490-f4ac-4320-8dec-2607b6acf3ff tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:35.695245 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-2f7fd490-f4ac-4320-8dec-2607b6acf3ff tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:35.774015 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-f5a8a673-616f-4a65-a8f5-b1efc8ef4085 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:35.774569 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-2f7fd490-f4ac-4320-8dec-2607b6acf3ff tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:35.774798 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-f5a8a673-616f-4a65-a8f5-b1efc8ef4085 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] [instance: 37f3ca38-a4e1-4c99-ace3-be7264f28e4e] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:35.777091 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell0:SELECT=10 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:14:35.783809 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f5a8a673-616f-4a65-a8f5-b1efc8ef4085 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:35.783809 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f5a8a673-616f-4a65-a8f5-b1efc8ef4085 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:35.784201 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f5a8a673-616f-4a65-a8f5-b1efc8ef4085 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:35.784377 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-2f7fd490-f4ac-4320-8dec-2607b6acf3ff tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887" status: 200 len: 1299 microversion: 2.1 time: 0.102503 Jul 22 11:14:35.784832 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f5a8a673-616f-4a65-a8f5-b1efc8ef4085 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:35.785282 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 58/100] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:35 2022] GET /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887 => generated 1299 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:35.873984 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-101a8b65-52ed-4968-8cf4-58dc6587497b tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:35.874632 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-101a8b65-52ed-4968-8cf4-58dc6587497b tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:35.881443 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-101a8b65-52ed-4968-8cf4-58dc6587497b tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:35.881886 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-101a8b65-52ed-4968-8cf4-58dc6587497b tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:35.882667 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-101a8b65-52ed-4968-8cf4-58dc6587497b tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:35.883251 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-101a8b65-52ed-4968-8cf4-58dc6587497b tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:35.887754 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG dbcounter [-] [117884] Writing DB stats nova_cell1:SELECT=100 {{(pid=117884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:14:35.952626 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-f5a8a673-616f-4a65-a8f5-b1efc8ef4085 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5202e2bdba064c4aaa84e15e1f0f0dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cd35ed100244fdab3228d1afe62400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:35.954417 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-101a8b65-52ed-4968-8cf4-58dc6587497b tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:35.963590 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-101a8b65-52ed-4968-8cf4-58dc6587497b tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1287 microversion: 2.1 time: 0.094543 Jul 22 11:14:35.964582 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-f5a8a673-616f-4a65-a8f5-b1efc8ef4085 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] 10.222.0.20 "GET /compute/v2.1/servers/37f3ca38-a4e1-4c99-ace3-be7264f28e4e" status: 200 len: 1315 microversion: 2.1 time: 0.194367 Jul 22 11:14:35.964904 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 59/101] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:35 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1287 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:14:35.965177 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 43/102] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:35 2022] GET /compute/v2.1/servers/37f3ca38-a4e1-4c99-ace3-be7264f28e4e => generated 1315 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:36.573154 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-497e439c-79c1-49d0-b860-5dc2cec2f142 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:36.579731 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-497e439c-79c1-49d0-b860-5dc2cec2f142 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 3108d9e0-3b2d-402a-aaab-c313c30e7900] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:36.604556 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-497e439c-79c1-49d0-b860-5dc2cec2f142 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:36.608715 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-497e439c-79c1-49d0-b860-5dc2cec2f142 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:36.611857 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-497e439c-79c1-49d0-b860-5dc2cec2f142 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:36.612996 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-497e439c-79c1-49d0-b860-5dc2cec2f142 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:36.802006 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-d0ca8825-9e3a-4603-88b0-15fb97ce37dc tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:36.802506 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-d0ca8825-9e3a-4603-88b0-15fb97ce37dc tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 0501f722-7553-4cba-9675-7bcbabb72887] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:36.813715 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d0ca8825-9e3a-4603-88b0-15fb97ce37dc tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:36.814373 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d0ca8825-9e3a-4603-88b0-15fb97ce37dc tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:36.815048 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d0ca8825-9e3a-4603-88b0-15fb97ce37dc tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:36.816171 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d0ca8825-9e3a-4603-88b0-15fb97ce37dc tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:36.974570 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-d0ca8825-9e3a-4603-88b0-15fb97ce37dc tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:36.999773 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-d0ca8825-9e3a-4603-88b0-15fb97ce37dc tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887" status: 200 len: 1299 microversion: 2.1 time: 0.202376 Jul 22 11:14:37.001697 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 44/103] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:36 2022] GET /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887 => generated 1299 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:37.016440 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-bb2a572b-7cdb-4842-9c94-50566d3e4981 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:37.018344 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-bb2a572b-7cdb-4842-9c94-50566d3e4981 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] [instance: 37f3ca38-a4e1-4c99-ace3-be7264f28e4e] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:37.026155 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-bb2a572b-7cdb-4842-9c94-50566d3e4981 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:37.026991 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-bb2a572b-7cdb-4842-9c94-50566d3e4981 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:37.028116 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-bb2a572b-7cdb-4842-9c94-50566d3e4981 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:37.028726 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-bb2a572b-7cdb-4842-9c94-50566d3e4981 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:37.433523 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-497e439c-79c1-49d0-b860-5dc2cec2f142 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:37.448193 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-497e439c-79c1-49d0-b860-5dc2cec2f142 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900" status: 200 len: 1322 microversion: 2.1 time: 0.912103 Jul 22 11:14:37.449370 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 60/104] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:36 2022] GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900 => generated 1322 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:37.456571 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-d915d6cf-1de0-401b-b19a-4a746ca0114d tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:37.457384 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-d915d6cf-1de0-401b-b19a-4a746ca0114d tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:37.470360 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-d915d6cf-1de0-401b-b19a-4a746ca0114d tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:37.471034 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-d915d6cf-1de0-401b-b19a-4a746ca0114d tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:37.473352 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-d915d6cf-1de0-401b-b19a-4a746ca0114d tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:37.475516 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-d915d6cf-1de0-401b-b19a-4a746ca0114d tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:37.624589 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-bb2a572b-7cdb-4842-9c94-50566d3e4981 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5202e2bdba064c4aaa84e15e1f0f0dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cd35ed100244fdab3228d1afe62400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:37.642373 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-bb2a572b-7cdb-4842-9c94-50566d3e4981 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] 10.222.0.20 "GET /compute/v2.1/servers/37f3ca38-a4e1-4c99-ace3-be7264f28e4e" status: 200 len: 1315 microversion: 2.1 time: 0.636515 Jul 22 11:14:37.643451 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 45/105] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:37 2022] GET /compute/v2.1/servers/37f3ca38-a4e1-4c99-ace3-be7264f28e4e => generated 1315 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:37.650709 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-d915d6cf-1de0-401b-b19a-4a746ca0114d tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:37.667948 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-d915d6cf-1de0-401b-b19a-4a746ca0114d tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1293 microversion: 2.1 time: 0.216644 Jul 22 11:14:37.668656 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 61/106] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:37 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1293 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:37.786355 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-08c48b86-7f8b-4ab3-bb87-22157ea02f19 req-c534db06-0f54-4629-aa3e-c2fd7f90559d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3108d9e0-3b2d-402a-aaab-c313c30e7900", "tag": "f7e02999-84b1-4561-a0b0-1237dc6412bb"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:14:37.801411 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-08c48b86-7f8b-4ab3-bb87-22157ea02f19 req-c534db06-0f54-4629-aa3e-c2fd7f90559d service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:37.805296 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-08c48b86-7f8b-4ab3-bb87-22157ea02f19 req-c534db06-0f54-4629-aa3e-c2fd7f90559d service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:37.836737 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-08c48b86-7f8b-4ab3-bb87-22157ea02f19 req-c534db06-0f54-4629-aa3e-c2fd7f90559d service nova] Creating event network-changed:f7e02999-84b1-4561-a0b0-1237dc6412bb for instance 3108d9e0-3b2d-402a-aaab-c313c30e7900 on hv-cinder-84890 Jul 22 11:14:37.851762 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-08c48b86-7f8b-4ab3-bb87-22157ea02f19 req-c534db06-0f54-4629-aa3e-c2fd7f90559d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069086 Jul 22 11:14:37.855210 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 46/107] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:14:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:14:38.018030 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-6313d884-c15e-45fc-b37f-437c5b17efb5 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:38.018640 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-6313d884-c15e-45fc-b37f-437c5b17efb5 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 0501f722-7553-4cba-9675-7bcbabb72887] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:38.041186 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-6313d884-c15e-45fc-b37f-437c5b17efb5 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:38.041558 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-6313d884-c15e-45fc-b37f-437c5b17efb5 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:38.042668 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-6313d884-c15e-45fc-b37f-437c5b17efb5 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:38.043241 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-6313d884-c15e-45fc-b37f-437c5b17efb5 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:38.259966 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-6313d884-c15e-45fc-b37f-437c5b17efb5 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:38.272023 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-6313d884-c15e-45fc-b37f-437c5b17efb5 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887" status: 200 len: 1299 microversion: 2.1 time: 0.257797 Jul 22 11:14:38.283382 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 62/108] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:38 2022] GET /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887 => generated 1299 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:38.467335 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-81896e90-c1a7-4f75-9644-d1f1b7c42f14 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:38.468300 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-81896e90-c1a7-4f75-9644-d1f1b7c42f14 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 3108d9e0-3b2d-402a-aaab-c313c30e7900] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:38.479450 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-81896e90-c1a7-4f75-9644-d1f1b7c42f14 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:38.497229 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-81896e90-c1a7-4f75-9644-d1f1b7c42f14 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:38.499473 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-81896e90-c1a7-4f75-9644-d1f1b7c42f14 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:38.500373 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-81896e90-c1a7-4f75-9644-d1f1b7c42f14 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:38.665822 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-f6cd06af-4c99-4d76-8235-c2acf9782d22 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:38.667757 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-f6cd06af-4c99-4d76-8235-c2acf9782d22 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] [instance: 37f3ca38-a4e1-4c99-ace3-be7264f28e4e] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:38.692773 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f6cd06af-4c99-4d76-8235-c2acf9782d22 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:38.697904 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f6cd06af-4c99-4d76-8235-c2acf9782d22 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:38.700243 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f6cd06af-4c99-4d76-8235-c2acf9782d22 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:38.701014 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f6cd06af-4c99-4d76-8235-c2acf9782d22 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:38.806438 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-81896e90-c1a7-4f75-9644-d1f1b7c42f14 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:38.824720 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-81896e90-c1a7-4f75-9644-d1f1b7c42f14 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900" status: 200 len: 1322 microversion: 2.1 time: 0.362187 Jul 22 11:14:38.828737 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 47/109] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:38 2022] GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900 => generated 1322 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:38.837457 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-298b7d61-cc5d-4ced-b29d-21ac896a70f8 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:38.838275 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-298b7d61-cc5d-4ced-b29d-21ac896a70f8 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:38.855243 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-298b7d61-cc5d-4ced-b29d-21ac896a70f8 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:38.857055 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-298b7d61-cc5d-4ced-b29d-21ac896a70f8 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:38.860194 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-298b7d61-cc5d-4ced-b29d-21ac896a70f8 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:38.863459 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-298b7d61-cc5d-4ced-b29d-21ac896a70f8 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:39.038005 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-298b7d61-cc5d-4ced-b29d-21ac896a70f8 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:39.043431 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=100 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:14:39.052174 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-298b7d61-cc5d-4ced-b29d-21ac896a70f8 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1293 microversion: 2.1 time: 0.221186 Jul 22 11:14:39.063802 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 48/110] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:38 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1293 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:39.184792 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-f6cd06af-4c99-4d76-8235-c2acf9782d22 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5202e2bdba064c4aaa84e15e1f0f0dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cd35ed100244fdab3228d1afe62400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:39.199075 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-f6cd06af-4c99-4d76-8235-c2acf9782d22 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] 10.222.0.20 "GET /compute/v2.1/servers/37f3ca38-a4e1-4c99-ace3-be7264f28e4e" status: 200 len: 1315 microversion: 2.1 time: 0.542579 Jul 22 11:14:39.199721 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 63/111] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:38 2022] GET /compute/v2.1/servers/37f3ca38-a4e1-4c99-ace3-be7264f28e4e => generated 1315 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:14:39.292100 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-98657f0a-e0cf-413c-8e9c-bd7df91e6faf tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:39.292782 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-98657f0a-e0cf-413c-8e9c-bd7df91e6faf tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 0501f722-7553-4cba-9675-7bcbabb72887] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:39.299514 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-98657f0a-e0cf-413c-8e9c-bd7df91e6faf tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:39.299962 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-98657f0a-e0cf-413c-8e9c-bd7df91e6faf tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:39.300764 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-98657f0a-e0cf-413c-8e9c-bd7df91e6faf tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:39.301195 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-98657f0a-e0cf-413c-8e9c-bd7df91e6faf tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:39.495045 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-98657f0a-e0cf-413c-8e9c-bd7df91e6faf tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:39.505521 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-98657f0a-e0cf-413c-8e9c-bd7df91e6faf tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887" status: 200 len: 1366 microversion: 2.1 time: 0.217066 Jul 22 11:14:39.505521 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 49/112] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:39 2022] GET /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887 => generated 1366 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:39.848993 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-c1b9af29-da10-46e1-8a44-39aac4f0623b tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:39.849954 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-c1b9af29-da10-46e1-8a44-39aac4f0623b tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 3108d9e0-3b2d-402a-aaab-c313c30e7900] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:39.859719 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c1b9af29-da10-46e1-8a44-39aac4f0623b tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:39.860381 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c1b9af29-da10-46e1-8a44-39aac4f0623b tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:39.862103 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c1b9af29-da10-46e1-8a44-39aac4f0623b tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:39.862552 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c1b9af29-da10-46e1-8a44-39aac4f0623b tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:40.070820 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-0959ff21-a21d-4c4a-9915-60b2af05e8a8 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:40.071661 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-0959ff21-a21d-4c4a-9915-60b2af05e8a8 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:40.086757 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0959ff21-a21d-4c4a-9915-60b2af05e8a8 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:40.087308 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0959ff21-a21d-4c4a-9915-60b2af05e8a8 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:40.088132 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0959ff21-a21d-4c4a-9915-60b2af05e8a8 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:40.088547 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0959ff21-a21d-4c4a-9915-60b2af05e8a8 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:40.513208 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-0959ff21-a21d-4c4a-9915-60b2af05e8a8 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:40.532536 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-0959ff21-a21d-4c4a-9915-60b2af05e8a8 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1360 microversion: 2.1 time: 0.465599 Jul 22 11:14:40.533637 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 50/113] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:40 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1360 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:40.542966 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-003768ee-cc0e-42dc-805f-6e3077faf3c9 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:40.544038 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-003768ee-cc0e-42dc-805f-6e3077faf3c9 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] [instance: 37f3ca38-a4e1-4c99-ace3-be7264f28e4e] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:40.551650 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-003768ee-cc0e-42dc-805f-6e3077faf3c9 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:40.552090 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-003768ee-cc0e-42dc-805f-6e3077faf3c9 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:40.553084 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-003768ee-cc0e-42dc-805f-6e3077faf3c9 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:40.553519 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-003768ee-cc0e-42dc-805f-6e3077faf3c9 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:40.589683 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-c1b9af29-da10-46e1-8a44-39aac4f0623b tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:40.608927 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-c1b9af29-da10-46e1-8a44-39aac4f0623b tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900" status: 200 len: 1322 microversion: 2.1 time: 0.767094 Jul 22 11:14:40.609782 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 64/114] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:39 2022] GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900 => generated 1322 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:40.629242 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-b9130435-80f6-4415-baff-3f54306cd527 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:40.630448 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-b9130435-80f6-4415-baff-3f54306cd527 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 0501f722-7553-4cba-9675-7bcbabb72887] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:40.638955 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-b9130435-80f6-4415-baff-3f54306cd527 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:40.639621 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-b9130435-80f6-4415-baff-3f54306cd527 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:40.640761 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-b9130435-80f6-4415-baff-3f54306cd527 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:40.641331 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-b9130435-80f6-4415-baff-3f54306cd527 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:40.900547 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-003768ee-cc0e-42dc-805f-6e3077faf3c9 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5202e2bdba064c4aaa84e15e1f0f0dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cd35ed100244fdab3228d1afe62400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:40.910742 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-003768ee-cc0e-42dc-805f-6e3077faf3c9 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] 10.222.0.20 "GET /compute/v2.1/servers/37f3ca38-a4e1-4c99-ace3-be7264f28e4e" status: 200 len: 1315 microversion: 2.1 time: 0.374179 Jul 22 11:14:40.914880 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 51/115] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:40 2022] GET /compute/v2.1/servers/37f3ca38-a4e1-4c99-ace3-be7264f28e4e => generated 1315 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:41.129669 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-b9130435-80f6-4415-baff-3f54306cd527 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:41.149925 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-b9130435-80f6-4415-baff-3f54306cd527 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887" status: 200 len: 1366 microversion: 2.1 time: 0.533683 Jul 22 11:14:41.159446 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 65/116] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:40 2022] GET /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887 => generated 1366 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:41.552269 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-a75fecd8-7ddf-4587-b8b7-8bbc0814bf93 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:41.553553 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-a75fecd8-7ddf-4587-b8b7-8bbc0814bf93 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:41.578925 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a75fecd8-7ddf-4587-b8b7-8bbc0814bf93 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:41.589388 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a75fecd8-7ddf-4587-b8b7-8bbc0814bf93 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:41.590396 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a75fecd8-7ddf-4587-b8b7-8bbc0814bf93 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:41.590852 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a75fecd8-7ddf-4587-b8b7-8bbc0814bf93 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:41.623702 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [req-96aa332e-77dd-422c-9cc9-7c092c6a86ef req-4211f717-df4f-40d2-aa27-8a66278bd18f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cafe061-7a16-4c2c-8796-da7dac3f27f1", "tag": "d89d05f5-4d23-40cd-88f2-d3ff71f50ba0"}]} {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:14:41.651218 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-96aa332e-77dd-422c-9cc9-7c092c6a86ef req-4211f717-df4f-40d2-aa27-8a66278bd18f service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:41.652449 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-96aa332e-77dd-422c-9cc9-7c092c6a86ef req-4211f717-df4f-40d2-aa27-8a66278bd18f service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:41.691101 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.compute.server_external_events [req-96aa332e-77dd-422c-9cc9-7c092c6a86ef req-4211f717-df4f-40d2-aa27-8a66278bd18f service nova] Creating event network-changed:d89d05f5-4d23-40cd-88f2-d3ff71f50ba0 for instance 1cafe061-7a16-4c2c-8796-da7dac3f27f1 on hv-cinder-84890 Jul 22 11:14:41.717644 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [req-96aa332e-77dd-422c-9cc9-7c092c6a86ef req-4211f717-df4f-40d2-aa27-8a66278bd18f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099627 Jul 22 11:14:41.719458 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 66/117] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:14:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 22 11:14:41.742964 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-e7cda13c-0bc7-441c-8df5-abbd549cdcc6 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:41.744399 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-e7cda13c-0bc7-441c-8df5-abbd549cdcc6 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 3108d9e0-3b2d-402a-aaab-c313c30e7900] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:41.755805 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-e7cda13c-0bc7-441c-8df5-abbd549cdcc6 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:41.756959 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-e7cda13c-0bc7-441c-8df5-abbd549cdcc6 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:41.758744 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-e7cda13c-0bc7-441c-8df5-abbd549cdcc6 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:41.760008 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-e7cda13c-0bc7-441c-8df5-abbd549cdcc6 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:41.999968 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-e7cda13c-0bc7-441c-8df5-abbd549cdcc6 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:42.016627 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-e7cda13c-0bc7-441c-8df5-abbd549cdcc6 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900" status: 200 len: 1322 microversion: 2.1 time: 0.294864 Jul 22 11:14:42.018131 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 67/118] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:41 2022] GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900 => generated 1322 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:42.023234 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-f761fc19-36e5-45c0-ba43-bf942e13f040 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:42.031225 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-f761fc19-36e5-45c0-ba43-bf942e13f040 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] [instance: 37f3ca38-a4e1-4c99-ace3-be7264f28e4e] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:42.046381 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f761fc19-36e5-45c0-ba43-bf942e13f040 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:42.047035 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f761fc19-36e5-45c0-ba43-bf942e13f040 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:42.048589 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f761fc19-36e5-45c0-ba43-bf942e13f040 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:42.051450 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f761fc19-36e5-45c0-ba43-bf942e13f040 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:42.308938 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-a75fecd8-7ddf-4587-b8b7-8bbc0814bf93 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:42.333701 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-a75fecd8-7ddf-4587-b8b7-8bbc0814bf93 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1360 microversion: 2.1 time: 0.786311 Jul 22 11:14:42.334529 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 52/119] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:41 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1360 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:42.352009 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-cd77417e-8554-45ed-b3b7-e1bde8dd820e tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:42.355119 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-cd77417e-8554-45ed-b3b7-e1bde8dd820e tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 0501f722-7553-4cba-9675-7bcbabb72887] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:42.373472 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-cd77417e-8554-45ed-b3b7-e1bde8dd820e tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:42.374248 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-cd77417e-8554-45ed-b3b7-e1bde8dd820e tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:42.377603 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-cd77417e-8554-45ed-b3b7-e1bde8dd820e tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:42.381135 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-cd77417e-8554-45ed-b3b7-e1bde8dd820e tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:42.866243 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-cd77417e-8554-45ed-b3b7-e1bde8dd820e tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:42.878381 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-cd77417e-8554-45ed-b3b7-e1bde8dd820e tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887" status: 200 len: 1366 microversion: 2.1 time: 0.540109 Jul 22 11:14:42.879598 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 53/120] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:42 2022] GET /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887 => generated 1366 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:42.885162 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-22646591-e179-4873-97fd-0eef3c1a3b4f req-88cdb7ff-df50-4607-b9f6-ff0fc5c48e36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0501f722-7553-4cba-9675-7bcbabb72887", "tag": "3c9a61a2-8eae-42fd-91d8-ee04df69941e"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:14:42.902549 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-22646591-e179-4873-97fd-0eef3c1a3b4f req-88cdb7ff-df50-4607-b9f6-ff0fc5c48e36 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:42.903008 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-22646591-e179-4873-97fd-0eef3c1a3b4f req-88cdb7ff-df50-4607-b9f6-ff0fc5c48e36 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:42.918243 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-22646591-e179-4873-97fd-0eef3c1a3b4f req-88cdb7ff-df50-4607-b9f6-ff0fc5c48e36 service nova] Creating event network-changed:3c9a61a2-8eae-42fd-91d8-ee04df69941e for instance 0501f722-7553-4cba-9675-7bcbabb72887 on hv-cinder-84890 Jul 22 11:14:42.925821 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-22646591-e179-4873-97fd-0eef3c1a3b4f req-88cdb7ff-df50-4607-b9f6-ff0fc5c48e36 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044578 Jul 22 11:14:42.926788 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 54/121] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:14:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:14:42.936344 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-f761fc19-36e5-45c0-ba43-bf942e13f040 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5202e2bdba064c4aaa84e15e1f0f0dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cd35ed100244fdab3228d1afe62400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:42.946277 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-f761fc19-36e5-45c0-ba43-bf942e13f040 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] 10.222.0.20 "GET /compute/v2.1/servers/37f3ca38-a4e1-4c99-ace3-be7264f28e4e" status: 200 len: 1315 microversion: 2.1 time: 0.926559 Jul 22 11:14:42.947354 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 68/122] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:42 2022] GET /compute/v2.1/servers/37f3ca38-a4e1-4c99-ace3-be7264f28e4e => generated 1315 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:43.041052 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-a1db4890-55ad-4ea9-b37d-5f9e0be1dffb tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:43.041755 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-a1db4890-55ad-4ea9-b37d-5f9e0be1dffb tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 3108d9e0-3b2d-402a-aaab-c313c30e7900] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:43.054945 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a1db4890-55ad-4ea9-b37d-5f9e0be1dffb tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:43.056693 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a1db4890-55ad-4ea9-b37d-5f9e0be1dffb tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:43.057941 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a1db4890-55ad-4ea9-b37d-5f9e0be1dffb tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:43.058886 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a1db4890-55ad-4ea9-b37d-5f9e0be1dffb tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:43.337307 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-a1db4890-55ad-4ea9-b37d-5f9e0be1dffb tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:43.347805 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-a1db4890-55ad-4ea9-b37d-5f9e0be1dffb tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900" status: 200 len: 1322 microversion: 2.1 time: 0.309186 Jul 22 11:14:43.348411 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 55/123] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:43 2022] GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900 => generated 1322 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:43.362374 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-253b9fa3-818f-4cb6-820d-73c355bd1ec3 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:43.364407 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-253b9fa3-818f-4cb6-820d-73c355bd1ec3 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:43.380224 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-253b9fa3-818f-4cb6-820d-73c355bd1ec3 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:43.381524 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-253b9fa3-818f-4cb6-820d-73c355bd1ec3 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:43.384540 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-253b9fa3-818f-4cb6-820d-73c355bd1ec3 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:43.386110 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-253b9fa3-818f-4cb6-820d-73c355bd1ec3 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:43.898060 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-51ea97c7-c158-4101-a1ab-329d9f5d5cec tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:43.899598 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-51ea97c7-c158-4101-a1ab-329d9f5d5cec tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 0501f722-7553-4cba-9675-7bcbabb72887] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:43.912017 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-51ea97c7-c158-4101-a1ab-329d9f5d5cec tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:43.913061 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-51ea97c7-c158-4101-a1ab-329d9f5d5cec tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:43.915930 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-51ea97c7-c158-4101-a1ab-329d9f5d5cec tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:43.916827 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-51ea97c7-c158-4101-a1ab-329d9f5d5cec tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:43.991286 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-253b9fa3-818f-4cb6-820d-73c355bd1ec3 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:44.005238 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-253b9fa3-818f-4cb6-820d-73c355bd1ec3 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1360 microversion: 2.1 time: 0.657812 Jul 22 11:14:44.005841 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 69/124] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:43 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1360 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:14:44.010996 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-e8976ac9-0900-460d-b0d4-241198823daa tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:44.022170 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-e8976ac9-0900-460d-b0d4-241198823daa tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] [instance: 37f3ca38-a4e1-4c99-ace3-be7264f28e4e] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:44.042516 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-e8976ac9-0900-460d-b0d4-241198823daa tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:44.047831 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-e8976ac9-0900-460d-b0d4-241198823daa tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:44.049114 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-e8976ac9-0900-460d-b0d4-241198823daa tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:44.050046 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-e8976ac9-0900-460d-b0d4-241198823daa tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:44.222230 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-51ea97c7-c158-4101-a1ab-329d9f5d5cec tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:44.237521 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-51ea97c7-c158-4101-a1ab-329d9f5d5cec tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887" status: 200 len: 1366 microversion: 2.1 time: 0.344016 Jul 22 11:14:44.247455 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 56/125] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:43 2022] GET /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887 => generated 1366 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:14:44.299040 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-e8976ac9-0900-460d-b0d4-241198823daa tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5202e2bdba064c4aaa84e15e1f0f0dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cd35ed100244fdab3228d1afe62400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:44.311433 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-e8976ac9-0900-460d-b0d4-241198823daa tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] 10.222.0.20 "GET /compute/v2.1/servers/37f3ca38-a4e1-4c99-ace3-be7264f28e4e" status: 200 len: 1315 microversion: 2.1 time: 0.303799 Jul 22 11:14:44.312796 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 70/126] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:44 2022] GET /compute/v2.1/servers/37f3ca38-a4e1-4c99-ace3-be7264f28e4e => generated 1315 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:44.367295 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-440c0e99-6d6c-46c7-9eee-850d5ec70b95 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:44.367973 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-440c0e99-6d6c-46c7-9eee-850d5ec70b95 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 3108d9e0-3b2d-402a-aaab-c313c30e7900] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:44.379298 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-440c0e99-6d6c-46c7-9eee-850d5ec70b95 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:44.380186 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-440c0e99-6d6c-46c7-9eee-850d5ec70b95 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:44.382449 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-440c0e99-6d6c-46c7-9eee-850d5ec70b95 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:44.383108 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-440c0e99-6d6c-46c7-9eee-850d5ec70b95 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:44.480057 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-d8d522a5-c28e-412c-a2ff-a35fc5bde60b req-94c1c02b-9824-47dc-a4a9-b526fd6c55da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37f3ca38-a4e1-4c99-ace3-be7264f28e4e", "name": "network-vif-plugged", "status": "completed", "tag": "65b00a5d-a3ec-4ac4-81fb-4c9f29a071f8"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:14:44.498163 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-d8d522a5-c28e-412c-a2ff-a35fc5bde60b req-94c1c02b-9824-47dc-a4a9-b526fd6c55da service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:44.499932 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-d8d522a5-c28e-412c-a2ff-a35fc5bde60b req-94c1c02b-9824-47dc-a4a9-b526fd6c55da service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:44.529361 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-d8d522a5-c28e-412c-a2ff-a35fc5bde60b req-94c1c02b-9824-47dc-a4a9-b526fd6c55da service nova] Creating event network-vif-plugged:65b00a5d-a3ec-4ac4-81fb-4c9f29a071f8 for instance 37f3ca38-a4e1-4c99-ace3-be7264f28e4e on hv-cinder-84890 Jul 22 11:14:44.548586 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-d8d522a5-c28e-412c-a2ff-a35fc5bde60b req-94c1c02b-9824-47dc-a4a9-b526fd6c55da service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.299433 Jul 22 11:14:44.551357 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 57/127] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:14:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:14:44.635229 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-440c0e99-6d6c-46c7-9eee-850d5ec70b95 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:44.654859 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-440c0e99-6d6c-46c7-9eee-850d5ec70b95 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900" status: 200 len: 1322 microversion: 2.1 time: 0.290725 Jul 22 11:14:44.656690 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 71/128] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:44 2022] GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900 => generated 1322 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:14:45.030165 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-7b489387-0760-48b6-b48b-512c0cfdb5d7 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:45.030865 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-7b489387-0760-48b6-b48b-512c0cfdb5d7 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:45.047466 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7b489387-0760-48b6-b48b-512c0cfdb5d7 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:45.048542 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7b489387-0760-48b6-b48b-512c0cfdb5d7 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:45.049666 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7b489387-0760-48b6-b48b-512c0cfdb5d7 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:45.050109 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7b489387-0760-48b6-b48b-512c0cfdb5d7 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:45.256358 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-81794279-d6b0-4442-83de-bd7dc716514a tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:45.258555 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-81794279-d6b0-4442-83de-bd7dc716514a tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 0501f722-7553-4cba-9675-7bcbabb72887] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:45.283584 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-81794279-d6b0-4442-83de-bd7dc716514a tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:45.285720 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-81794279-d6b0-4442-83de-bd7dc716514a tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:45.289232 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-81794279-d6b0-4442-83de-bd7dc716514a tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:45.289913 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-81794279-d6b0-4442-83de-bd7dc716514a tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:45.416441 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-7b489387-0760-48b6-b48b-512c0cfdb5d7 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:45.425449 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-7b489387-0760-48b6-b48b-512c0cfdb5d7 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1360 microversion: 2.1 time: 0.400109 Jul 22 11:14:45.426062 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 58/129] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:45 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1360 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:45.451141 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-645f01ca-5886-498b-8eab-9907133b2909 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:45.451537 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-645f01ca-5886-498b-8eab-9907133b2909 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] [instance: 37f3ca38-a4e1-4c99-ace3-be7264f28e4e] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:45.482774 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-645f01ca-5886-498b-8eab-9907133b2909 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:45.488577 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-645f01ca-5886-498b-8eab-9907133b2909 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:45.493732 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-645f01ca-5886-498b-8eab-9907133b2909 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:45.494492 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-645f01ca-5886-498b-8eab-9907133b2909 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:46.015289 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-645f01ca-5886-498b-8eab-9907133b2909 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5202e2bdba064c4aaa84e15e1f0f0dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cd35ed100244fdab3228d1afe62400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:46.038190 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-645f01ca-5886-498b-8eab-9907133b2909 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] 10.222.0.20 "GET /compute/v2.1/servers/37f3ca38-a4e1-4c99-ace3-be7264f28e4e" status: 200 len: 1315 microversion: 2.1 time: 0.592831 Jul 22 11:14:46.041926 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 59/130] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:45 2022] GET /compute/v2.1/servers/37f3ca38-a4e1-4c99-ace3-be7264f28e4e => generated 1315 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:46.057010 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-6fe56f10-e4ee-4b6e-8d09-8e59e06a774f tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:46.059925 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-6fe56f10-e4ee-4b6e-8d09-8e59e06a774f tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 3108d9e0-3b2d-402a-aaab-c313c30e7900] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:46.075145 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6fe56f10-e4ee-4b6e-8d09-8e59e06a774f tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:46.078200 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6fe56f10-e4ee-4b6e-8d09-8e59e06a774f tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:46.081375 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6fe56f10-e4ee-4b6e-8d09-8e59e06a774f tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:46.082109 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6fe56f10-e4ee-4b6e-8d09-8e59e06a774f tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:46.307452 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-81794279-d6b0-4442-83de-bd7dc716514a tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:46.315695 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-81794279-d6b0-4442-83de-bd7dc716514a tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887" status: 200 len: 1366 microversion: 2.1 time: 1.065177 Jul 22 11:14:46.323225 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 72/131] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:45 2022] GET /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887 => generated 1366 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:14:46.435052 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-6fe56f10-e4ee-4b6e-8d09-8e59e06a774f tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:46.443252 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-d642c23d-47f7-4548-a907-16a872025b53 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:46.443874 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-d642c23d-47f7-4548-a907-16a872025b53 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:46.447192 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-6fe56f10-e4ee-4b6e-8d09-8e59e06a774f tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900" status: 200 len: 1322 microversion: 2.1 time: 0.401383 Jul 22 11:14:46.453232 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-d642c23d-47f7-4548-a907-16a872025b53 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:46.453691 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-d642c23d-47f7-4548-a907-16a872025b53 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:46.454673 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-d642c23d-47f7-4548-a907-16a872025b53 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:46.455116 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-d642c23d-47f7-4548-a907-16a872025b53 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:46.458317 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 60/132] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:46 2022] GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900 => generated 1322 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:46.578901 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-77a5c201-5fee-4c9c-82ea-3af47da10426 req-2d9a6405-9992-4710-bb7f-1ef53e9265db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3108d9e0-3b2d-402a-aaab-c313c30e7900", "name": "network-vif-plugged", "status": "completed", "tag": "f7e02999-84b1-4561-a0b0-1237dc6412bb"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:14:46.587742 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-77a5c201-5fee-4c9c-82ea-3af47da10426 req-2d9a6405-9992-4710-bb7f-1ef53e9265db service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:46.588382 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-77a5c201-5fee-4c9c-82ea-3af47da10426 req-2d9a6405-9992-4710-bb7f-1ef53e9265db service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:46.600327 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-77a5c201-5fee-4c9c-82ea-3af47da10426 req-2d9a6405-9992-4710-bb7f-1ef53e9265db service nova] Creating event network-vif-plugged:f7e02999-84b1-4561-a0b0-1237dc6412bb for instance 3108d9e0-3b2d-402a-aaab-c313c30e7900 on hv-cinder-84890 Jul 22 11:14:46.606218 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-77a5c201-5fee-4c9c-82ea-3af47da10426 req-2d9a6405-9992-4710-bb7f-1ef53e9265db service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030921 Jul 22 11:14:46.607418 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 61/133] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:14:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:14:46.611401 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-d642c23d-47f7-4548-a907-16a872025b53 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:46.619438 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-d642c23d-47f7-4548-a907-16a872025b53 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1360 microversion: 2.1 time: 0.180566 Jul 22 11:14:46.620035 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 73/134] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:46 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1360 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:14:47.064070 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-8c5da683-2094-4d4e-8ba2-69a92ce546d3 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:47.064666 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-8c5da683-2094-4d4e-8ba2-69a92ce546d3 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] [instance: 37f3ca38-a4e1-4c99-ace3-be7264f28e4e] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:47.071349 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8c5da683-2094-4d4e-8ba2-69a92ce546d3 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:47.071716 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8c5da683-2094-4d4e-8ba2-69a92ce546d3 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:47.072483 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8c5da683-2094-4d4e-8ba2-69a92ce546d3 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:47.072913 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8c5da683-2094-4d4e-8ba2-69a92ce546d3 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:47.227163 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-8c5da683-2094-4d4e-8ba2-69a92ce546d3 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5202e2bdba064c4aaa84e15e1f0f0dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cd35ed100244fdab3228d1afe62400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:47.238910 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-8c5da683-2094-4d4e-8ba2-69a92ce546d3 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] 10.222.0.20 "GET /compute/v2.1/servers/37f3ca38-a4e1-4c99-ace3-be7264f28e4e" status: 200 len: 1315 microversion: 2.1 time: 0.179227 Jul 22 11:14:47.239720 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 62/135] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:47 2022] GET /compute/v2.1/servers/37f3ca38-a4e1-4c99-ace3-be7264f28e4e => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:47.341336 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-ab52a92f-deb1-4261-bd0c-1840b08c4b27 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:47.341956 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-ab52a92f-deb1-4261-bd0c-1840b08c4b27 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 0501f722-7553-4cba-9675-7bcbabb72887] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:47.349007 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-ab52a92f-deb1-4261-bd0c-1840b08c4b27 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:47.349339 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-ab52a92f-deb1-4261-bd0c-1840b08c4b27 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:47.350109 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-ab52a92f-deb1-4261-bd0c-1840b08c4b27 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:47.350548 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-ab52a92f-deb1-4261-bd0c-1840b08c4b27 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:47.465170 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-8b3e595a-51c3-4660-88ba-ef3ab37c3514 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:47.465929 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-8b3e595a-51c3-4660-88ba-ef3ab37c3514 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 3108d9e0-3b2d-402a-aaab-c313c30e7900] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:47.475647 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8b3e595a-51c3-4660-88ba-ef3ab37c3514 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:47.476231 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8b3e595a-51c3-4660-88ba-ef3ab37c3514 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:47.477719 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8b3e595a-51c3-4660-88ba-ef3ab37c3514 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:47.478372 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8b3e595a-51c3-4660-88ba-ef3ab37c3514 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:47.512694 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-ab52a92f-deb1-4261-bd0c-1840b08c4b27 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:47.524724 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-ab52a92f-deb1-4261-bd0c-1840b08c4b27 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887" status: 200 len: 1366 microversion: 2.1 time: 0.187299 Jul 22 11:14:47.525693 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 74/136] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:47 2022] GET /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887 => generated 1366 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:47.635138 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-8b3e595a-51c3-4660-88ba-ef3ab37c3514 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:47.636544 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-c5fcffd3-74be-481c-a61e-cb836c592aa8 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:47.638310 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-c5fcffd3-74be-481c-a61e-cb836c592aa8 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:47.645215 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-8b3e595a-51c3-4660-88ba-ef3ab37c3514 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900" status: 200 len: 1322 microversion: 2.1 time: 0.184731 Jul 22 11:14:47.646886 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 63/137] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:47 2022] GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900 => generated 1322 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:14:47.657028 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c5fcffd3-74be-481c-a61e-cb836c592aa8 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:47.657592 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c5fcffd3-74be-481c-a61e-cb836c592aa8 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:47.658678 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c5fcffd3-74be-481c-a61e-cb836c592aa8 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:47.659409 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c5fcffd3-74be-481c-a61e-cb836c592aa8 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:47.810104 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-c5fcffd3-74be-481c-a61e-cb836c592aa8 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:47.822120 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-c5fcffd3-74be-481c-a61e-cb836c592aa8 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1360 microversion: 2.1 time: 0.189449 Jul 22 11:14:47.822850 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 75/138] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:47 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1360 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:48.256695 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-02226ba2-9b73-478c-8147-f26c95f0d152 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:48.257381 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-02226ba2-9b73-478c-8147-f26c95f0d152 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] [instance: 37f3ca38-a4e1-4c99-ace3-be7264f28e4e] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:48.263885 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-02226ba2-9b73-478c-8147-f26c95f0d152 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:48.264483 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-02226ba2-9b73-478c-8147-f26c95f0d152 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:48.265443 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-02226ba2-9b73-478c-8147-f26c95f0d152 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:48.265877 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-02226ba2-9b73-478c-8147-f26c95f0d152 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:48.452765 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-02226ba2-9b73-478c-8147-f26c95f0d152 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5202e2bdba064c4aaa84e15e1f0f0dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cd35ed100244fdab3228d1afe62400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:48.461187 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-02226ba2-9b73-478c-8147-f26c95f0d152 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] 10.222.0.20 "GET /compute/v2.1/servers/37f3ca38-a4e1-4c99-ace3-be7264f28e4e" status: 200 len: 1315 microversion: 2.1 time: 0.208581 Jul 22 11:14:48.462110 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 64/139] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:48 2022] GET /compute/v2.1/servers/37f3ca38-a4e1-4c99-ace3-be7264f28e4e => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:48.542926 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-330de476-0b0c-4431-a8c8-44b0d3fe2391 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:48.544170 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-330de476-0b0c-4431-a8c8-44b0d3fe2391 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 0501f722-7553-4cba-9675-7bcbabb72887] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:48.551153 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-330de476-0b0c-4431-a8c8-44b0d3fe2391 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:48.551622 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-330de476-0b0c-4431-a8c8-44b0d3fe2391 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:48.552435 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-330de476-0b0c-4431-a8c8-44b0d3fe2391 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:48.552867 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-330de476-0b0c-4431-a8c8-44b0d3fe2391 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:48.571750 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG dbcounter [-] [117884] Writing DB stats nova_cell1:SELECT=100 {{(pid=117884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:14:48.667695 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-f80716fe-b453-4272-9b91-e586516dd2f7 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:48.669162 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-f80716fe-b453-4272-9b91-e586516dd2f7 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 3108d9e0-3b2d-402a-aaab-c313c30e7900] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:48.683668 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f80716fe-b453-4272-9b91-e586516dd2f7 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:48.684825 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f80716fe-b453-4272-9b91-e586516dd2f7 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:48.686746 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f80716fe-b453-4272-9b91-e586516dd2f7 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:48.687893 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f80716fe-b453-4272-9b91-e586516dd2f7 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:48.760733 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-330de476-0b0c-4431-a8c8-44b0d3fe2391 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:48.779724 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-330de476-0b0c-4431-a8c8-44b0d3fe2391 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887" status: 200 len: 1366 microversion: 2.1 time: 0.239408 Jul 22 11:14:48.791292 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 76/140] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:48 2022] GET /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887 => generated 1366 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:48.848906 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-dd36a4e1-581d-418d-9965-81f8ffe1488e tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:48.849797 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-dd36a4e1-581d-418d-9965-81f8ffe1488e tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:48.858420 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-dd36a4e1-581d-418d-9965-81f8ffe1488e tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:48.859124 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-dd36a4e1-581d-418d-9965-81f8ffe1488e tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:48.860533 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-dd36a4e1-581d-418d-9965-81f8ffe1488e tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:48.861147 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-dd36a4e1-581d-418d-9965-81f8ffe1488e tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:48.977805 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-f80716fe-b453-4272-9b91-e586516dd2f7 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:48.986740 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-f80716fe-b453-4272-9b91-e586516dd2f7 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900" status: 200 len: 1322 microversion: 2.1 time: 0.327404 Jul 22 11:14:48.987353 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 65/141] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:48 2022] GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900 => generated 1322 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:14:49.152689 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-dd36a4e1-581d-418d-9965-81f8ffe1488e tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:49.164981 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-dd36a4e1-581d-418d-9965-81f8ffe1488e tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1360 microversion: 2.1 time: 0.327243 Jul 22 11:14:49.165275 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 77/142] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:48 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1360 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:49.479170 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-2f279ff8-fa50-47a8-9844-7bdb360ec821 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:49.480324 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-2f279ff8-fa50-47a8-9844-7bdb360ec821 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] [instance: 37f3ca38-a4e1-4c99-ace3-be7264f28e4e] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:49.501591 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2f279ff8-fa50-47a8-9844-7bdb360ec821 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:49.508007 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2f279ff8-fa50-47a8-9844-7bdb360ec821 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:49.509184 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2f279ff8-fa50-47a8-9844-7bdb360ec821 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:49.509801 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2f279ff8-fa50-47a8-9844-7bdb360ec821 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:49.706601 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-2f279ff8-fa50-47a8-9844-7bdb360ec821 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5202e2bdba064c4aaa84e15e1f0f0dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cd35ed100244fdab3228d1afe62400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:49.717420 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-2f279ff8-fa50-47a8-9844-7bdb360ec821 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] 10.222.0.20 "GET /compute/v2.1/servers/37f3ca38-a4e1-4c99-ace3-be7264f28e4e" status: 200 len: 1315 microversion: 2.1 time: 0.241664 Jul 22 11:14:49.719059 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 66/143] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:49 2022] GET /compute/v2.1/servers/37f3ca38-a4e1-4c99-ace3-be7264f28e4e => generated 1315 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:49.806979 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-6ee50435-8b08-4424-b94b-5f1624a5ce46 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:49.807625 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-6ee50435-8b08-4424-b94b-5f1624a5ce46 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 0501f722-7553-4cba-9675-7bcbabb72887] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:49.814384 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-6ee50435-8b08-4424-b94b-5f1624a5ce46 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:49.815011 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-6ee50435-8b08-4424-b94b-5f1624a5ce46 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:49.815985 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-6ee50435-8b08-4424-b94b-5f1624a5ce46 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:49.816574 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-6ee50435-8b08-4424-b94b-5f1624a5ce46 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:49.986775 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-6ee50435-8b08-4424-b94b-5f1624a5ce46 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:49.996071 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-6ee50435-8b08-4424-b94b-5f1624a5ce46 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887" status: 200 len: 1366 microversion: 2.1 time: 0.192796 Jul 22 11:14:49.996664 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 78/144] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:49 2022] GET /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887 => generated 1366 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:50.011572 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-20cf5cd2-72b5-4fea-a6e1-7e78ae51ea8e tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:50.012188 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-20cf5cd2-72b5-4fea-a6e1-7e78ae51ea8e tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 3108d9e0-3b2d-402a-aaab-c313c30e7900] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:50.017257 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_api:SELECT=97 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:14:50.019833 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-20cf5cd2-72b5-4fea-a6e1-7e78ae51ea8e tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:50.020652 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-20cf5cd2-72b5-4fea-a6e1-7e78ae51ea8e tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:50.021891 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-20cf5cd2-72b5-4fea-a6e1-7e78ae51ea8e tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:50.022331 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-20cf5cd2-72b5-4fea-a6e1-7e78ae51ea8e tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:50.043086 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=100 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:14:50.172061 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-20cf5cd2-72b5-4fea-a6e1-7e78ae51ea8e tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:50.180996 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-20cf5cd2-72b5-4fea-a6e1-7e78ae51ea8e tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900" status: 200 len: 1322 microversion: 2.1 time: 0.173152 Jul 22 11:14:50.181186 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-dc0a990b-552a-443e-81fd-befdc36985d3 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:50.181764 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-dc0a990b-552a-443e-81fd-befdc36985d3 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:50.182255 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 67/145] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:50 2022] GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900 => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:50.188834 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-dc0a990b-552a-443e-81fd-befdc36985d3 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:50.189275 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-dc0a990b-552a-443e-81fd-befdc36985d3 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:50.190045 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-dc0a990b-552a-443e-81fd-befdc36985d3 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:50.190629 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-dc0a990b-552a-443e-81fd-befdc36985d3 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:50.346408 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-dc0a990b-552a-443e-81fd-befdc36985d3 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:50.354345 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-dc0a990b-552a-443e-81fd-befdc36985d3 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1360 microversion: 2.1 time: 0.177016 Jul 22 11:14:50.355580 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 79/146] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:50 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1360 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:14:50.734040 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-ab34d8f7-4add-4349-a6eb-9b4e8be3d331 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:50.734652 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-ab34d8f7-4add-4349-a6eb-9b4e8be3d331 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] [instance: 37f3ca38-a4e1-4c99-ace3-be7264f28e4e] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:50.741458 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ab34d8f7-4add-4349-a6eb-9b4e8be3d331 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:50.742142 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ab34d8f7-4add-4349-a6eb-9b4e8be3d331 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:50.742928 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ab34d8f7-4add-4349-a6eb-9b4e8be3d331 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:50.743399 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ab34d8f7-4add-4349-a6eb-9b4e8be3d331 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:50.912934 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-ab34d8f7-4add-4349-a6eb-9b4e8be3d331 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5202e2bdba064c4aaa84e15e1f0f0dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cd35ed100244fdab3228d1afe62400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:50.920747 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-ab34d8f7-4add-4349-a6eb-9b4e8be3d331 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] 10.222.0.20 "GET /compute/v2.1/servers/37f3ca38-a4e1-4c99-ace3-be7264f28e4e" status: 200 len: 1315 microversion: 2.1 time: 0.190494 Jul 22 11:14:50.922051 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 68/147] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:50 2022] GET /compute/v2.1/servers/37f3ca38-a4e1-4c99-ace3-be7264f28e4e => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:51.014474 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-609d2354-2775-41fb-bb3a-4ebd6b307788 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:51.015696 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-609d2354-2775-41fb-bb3a-4ebd6b307788 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 0501f722-7553-4cba-9675-7bcbabb72887] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:51.022106 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-609d2354-2775-41fb-bb3a-4ebd6b307788 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:51.022726 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-609d2354-2775-41fb-bb3a-4ebd6b307788 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:51.023533 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-609d2354-2775-41fb-bb3a-4ebd6b307788 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:51.023964 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-609d2354-2775-41fb-bb3a-4ebd6b307788 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:51.177302 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-609d2354-2775-41fb-bb3a-4ebd6b307788 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:51.185948 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-609d2354-2775-41fb-bb3a-4ebd6b307788 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887" status: 200 len: 1366 microversion: 2.1 time: 0.175727 Jul 22 11:14:51.186964 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 80/148] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:51 2022] GET /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887 => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:51.203822 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-aedc0d77-9c4a-4616-bc73-ecb710f6a514 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:51.204909 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-aedc0d77-9c4a-4616-bc73-ecb710f6a514 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 3108d9e0-3b2d-402a-aaab-c313c30e7900] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:51.212062 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-aedc0d77-9c4a-4616-bc73-ecb710f6a514 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:51.212506 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-aedc0d77-9c4a-4616-bc73-ecb710f6a514 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:51.213654 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-aedc0d77-9c4a-4616-bc73-ecb710f6a514 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:51.214117 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-aedc0d77-9c4a-4616-bc73-ecb710f6a514 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:51.373020 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-aedc0d77-9c4a-4616-bc73-ecb710f6a514 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:51.373490 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-bd0e1336-e2dc-467c-91c9-9072b28bec28 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:51.375084 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-bd0e1336-e2dc-467c-91c9-9072b28bec28 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:51.382723 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-aedc0d77-9c4a-4616-bc73-ecb710f6a514 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900" status: 200 len: 1322 microversion: 2.1 time: 0.184200 Jul 22 11:14:51.383428 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-bd0e1336-e2dc-467c-91c9-9072b28bec28 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:51.383928 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 69/149] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:51 2022] GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900 => generated 1322 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:14:51.385154 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-bd0e1336-e2dc-467c-91c9-9072b28bec28 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:51.386155 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-bd0e1336-e2dc-467c-91c9-9072b28bec28 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:51.387391 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-bd0e1336-e2dc-467c-91c9-9072b28bec28 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:51.543578 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-bd0e1336-e2dc-467c-91c9-9072b28bec28 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:51.553694 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-bd0e1336-e2dc-467c-91c9-9072b28bec28 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1360 microversion: 2.1 time: 0.184540 Jul 22 11:14:51.557048 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 81/150] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:51 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1360 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:51.943167 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-c1c2d359-6846-47be-9c9e-fd074e2ec872 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:51.944616 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-c1c2d359-6846-47be-9c9e-fd074e2ec872 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] [instance: 37f3ca38-a4e1-4c99-ace3-be7264f28e4e] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:51.955677 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c1c2d359-6846-47be-9c9e-fd074e2ec872 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:51.956509 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c1c2d359-6846-47be-9c9e-fd074e2ec872 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:51.957975 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c1c2d359-6846-47be-9c9e-fd074e2ec872 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:51.958802 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c1c2d359-6846-47be-9c9e-fd074e2ec872 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:52.143244 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-c1c2d359-6846-47be-9c9e-fd074e2ec872 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5202e2bdba064c4aaa84e15e1f0f0dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cd35ed100244fdab3228d1afe62400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:52.158028 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-c1c2d359-6846-47be-9c9e-fd074e2ec872 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] 10.222.0.20 "GET /compute/v2.1/servers/37f3ca38-a4e1-4c99-ace3-be7264f28e4e" status: 200 len: 1315 microversion: 2.1 time: 0.221700 Jul 22 11:14:52.159142 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 70/151] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:51 2022] GET /compute/v2.1/servers/37f3ca38-a4e1-4c99-ace3-be7264f28e4e => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:52.215217 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-c855dc0a-8837-4fd6-8ce0-e392beef6763 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:52.215217 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-c855dc0a-8837-4fd6-8ce0-e392beef6763 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 0501f722-7553-4cba-9675-7bcbabb72887] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:52.217808 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c855dc0a-8837-4fd6-8ce0-e392beef6763 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:52.218261 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c855dc0a-8837-4fd6-8ce0-e392beef6763 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:52.220552 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c855dc0a-8837-4fd6-8ce0-e392beef6763 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:52.221132 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c855dc0a-8837-4fd6-8ce0-e392beef6763 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:52.404896 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-8a2e7b9a-32e9-489d-b503-dea342b3624a tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:52.405876 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-8a2e7b9a-32e9-489d-b503-dea342b3624a tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 3108d9e0-3b2d-402a-aaab-c313c30e7900] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:52.415619 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8a2e7b9a-32e9-489d-b503-dea342b3624a tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:52.416403 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8a2e7b9a-32e9-489d-b503-dea342b3624a tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:52.417417 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8a2e7b9a-32e9-489d-b503-dea342b3624a tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:52.418065 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8a2e7b9a-32e9-489d-b503-dea342b3624a tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:52.465228 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-c855dc0a-8837-4fd6-8ce0-e392beef6763 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:52.498246 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-c855dc0a-8837-4fd6-8ce0-e392beef6763 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887" status: 200 len: 1366 microversion: 2.1 time: 0.291814 Jul 22 11:14:52.498909 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 82/152] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:52 2022] GET /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887 => generated 1366 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:52.572068 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-530f01c6-3420-4b13-aee9-1c944ce95e8c tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:52.573038 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-530f01c6-3420-4b13-aee9-1c944ce95e8c tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:52.583504 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-530f01c6-3420-4b13-aee9-1c944ce95e8c tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:52.586135 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-530f01c6-3420-4b13-aee9-1c944ce95e8c tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:52.589048 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-530f01c6-3420-4b13-aee9-1c944ce95e8c tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:52.593175 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-530f01c6-3420-4b13-aee9-1c944ce95e8c tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:52.742073 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-8a2e7b9a-32e9-489d-b503-dea342b3624a tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:52.778883 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-8a2e7b9a-32e9-489d-b503-dea342b3624a tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900" status: 200 len: 1322 microversion: 2.1 time: 0.375992 Jul 22 11:14:52.780353 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 71/153] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:52 2022] GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900 => generated 1322 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:52.874375 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-7c215c7a-78eb-461b-a9a5-5499ca7ba59a req-f1dcbaf5-61be-4f6f-b1c8-b7f3d7245722 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbf8cb41-3496-45fe-9392-6add8f6873d0", "name": "network-vif-plugged", "status": "completed", "tag": "6c864331-87d8-4526-8824-f0d87403783e"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:14:52.884610 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-7c215c7a-78eb-461b-a9a5-5499ca7ba59a req-f1dcbaf5-61be-4f6f-b1c8-b7f3d7245722 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:52.885360 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-7c215c7a-78eb-461b-a9a5-5499ca7ba59a req-f1dcbaf5-61be-4f6f-b1c8-b7f3d7245722 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:52.911648 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-7c215c7a-78eb-461b-a9a5-5499ca7ba59a req-f1dcbaf5-61be-4f6f-b1c8-b7f3d7245722 service nova] Creating event network-vif-plugged:6c864331-87d8-4526-8824-f0d87403783e for instance fbf8cb41-3496-45fe-9392-6add8f6873d0 on hv-cinder-84890 Jul 22 11:14:52.921133 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-7c215c7a-78eb-461b-a9a5-5499ca7ba59a req-f1dcbaf5-61be-4f6f-b1c8-b7f3d7245722 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063671 Jul 22 11:14:52.922435 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 72/154] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:14:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:14:53.070900 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-530f01c6-3420-4b13-aee9-1c944ce95e8c tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:53.083530 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-530f01c6-3420-4b13-aee9-1c944ce95e8c tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1360 microversion: 2.1 time: 0.515154 Jul 22 11:14:53.094228 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 83/155] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:52 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1360 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:53.178875 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-c7eb93dc-2b51-42bf-8d61-d001ca5c7fec tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:53.180234 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-c7eb93dc-2b51-42bf-8d61-d001ca5c7fec tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] [instance: 37f3ca38-a4e1-4c99-ace3-be7264f28e4e] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:53.227806 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c7eb93dc-2b51-42bf-8d61-d001ca5c7fec tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:53.230833 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c7eb93dc-2b51-42bf-8d61-d001ca5c7fec tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:53.238512 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c7eb93dc-2b51-42bf-8d61-d001ca5c7fec tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:53.241066 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c7eb93dc-2b51-42bf-8d61-d001ca5c7fec tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:53.519868 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-ab1ef87f-bc78-4291-a8eb-83563f623d4b tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:53.521178 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-ab1ef87f-bc78-4291-a8eb-83563f623d4b tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 0501f722-7553-4cba-9675-7bcbabb72887] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:53.536455 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-ab1ef87f-bc78-4291-a8eb-83563f623d4b tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:53.538202 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-ab1ef87f-bc78-4291-a8eb-83563f623d4b tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:53.541170 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-ab1ef87f-bc78-4291-a8eb-83563f623d4b tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:53.542332 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-ab1ef87f-bc78-4291-a8eb-83563f623d4b tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:53.763871 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-c7eb93dc-2b51-42bf-8d61-d001ca5c7fec tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5202e2bdba064c4aaa84e15e1f0f0dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cd35ed100244fdab3228d1afe62400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:53.779548 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-c7eb93dc-2b51-42bf-8d61-d001ca5c7fec tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] 10.222.0.20 "GET /compute/v2.1/servers/37f3ca38-a4e1-4c99-ace3-be7264f28e4e" status: 200 len: 1315 microversion: 2.1 time: 0.607034 Jul 22 11:14:53.789552 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 73/156] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:53 2022] GET /compute/v2.1/servers/37f3ca38-a4e1-4c99-ace3-be7264f28e4e => generated 1315 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:53.800033 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-a5e74c92-8ebb-44f3-9a17-2cf46d94a65c tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:53.801771 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-a5e74c92-8ebb-44f3-9a17-2cf46d94a65c tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 3108d9e0-3b2d-402a-aaab-c313c30e7900] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:53.816454 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a5e74c92-8ebb-44f3-9a17-2cf46d94a65c tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:53.819096 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a5e74c92-8ebb-44f3-9a17-2cf46d94a65c tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:53.820378 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a5e74c92-8ebb-44f3-9a17-2cf46d94a65c tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:53.821020 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a5e74c92-8ebb-44f3-9a17-2cf46d94a65c tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:54.080964 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-ab1ef87f-bc78-4291-a8eb-83563f623d4b tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:54.089507 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-ab1ef87f-bc78-4291-a8eb-83563f623d4b tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887" status: 200 len: 1366 microversion: 2.1 time: 0.577831 Jul 22 11:14:54.090785 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 84/157] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:53 2022] GET /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887 => generated 1366 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:54.107808 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-717b05a4-881f-495f-af39-847a726fdcf5 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:54.108437 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-717b05a4-881f-495f-af39-847a726fdcf5 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:54.128752 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-717b05a4-881f-495f-af39-847a726fdcf5 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:54.130542 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-717b05a4-881f-495f-af39-847a726fdcf5 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:54.132288 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-717b05a4-881f-495f-af39-847a726fdcf5 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:54.132872 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-717b05a4-881f-495f-af39-847a726fdcf5 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:54.169426 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-a5e74c92-8ebb-44f3-9a17-2cf46d94a65c tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:54.177875 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-a5e74c92-8ebb-44f3-9a17-2cf46d94a65c tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900" status: 200 len: 1322 microversion: 2.1 time: 0.382707 Jul 22 11:14:54.182067 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 74/158] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:53 2022] GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900 => generated 1322 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:54.491542 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-717b05a4-881f-495f-af39-847a726fdcf5 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:54.518726 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-717b05a4-881f-495f-af39-847a726fdcf5 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1360 microversion: 2.1 time: 0.420749 Jul 22 11:14:54.520300 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 85/159] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:54 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1360 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:54.801223 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-0f225f96-e448-48a9-8690-cedada5c1331 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:54.802125 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-0f225f96-e448-48a9-8690-cedada5c1331 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] [instance: 37f3ca38-a4e1-4c99-ace3-be7264f28e4e] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:54.812149 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0f225f96-e448-48a9-8690-cedada5c1331 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:54.812919 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0f225f96-e448-48a9-8690-cedada5c1331 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:54.817269 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0f225f96-e448-48a9-8690-cedada5c1331 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:54.819883 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0f225f96-e448-48a9-8690-cedada5c1331 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:54.948345 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [req-7fd19a74-9451-456a-923f-7555060e2fa0 req-7896897f-5a0f-4511-8fdb-71f85c759df7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0501f722-7553-4cba-9675-7bcbabb72887", "name": "network-vif-plugged", "status": "completed", "tag": "3c9a61a2-8eae-42fd-91d8-ee04df69941e"}]} {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:14:54.965992 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-7fd19a74-9451-456a-923f-7555060e2fa0 req-7896897f-5a0f-4511-8fdb-71f85c759df7 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:54.966432 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-7fd19a74-9451-456a-923f-7555060e2fa0 req-7896897f-5a0f-4511-8fdb-71f85c759df7 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:54.991451 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.compute.server_external_events [req-7fd19a74-9451-456a-923f-7555060e2fa0 req-7896897f-5a0f-4511-8fdb-71f85c759df7 service nova] Creating event network-vif-plugged:3c9a61a2-8eae-42fd-91d8-ee04df69941e for instance 0501f722-7553-4cba-9675-7bcbabb72887 on hv-cinder-84890 Jul 22 11:14:54.999541 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [req-7fd19a74-9451-456a-923f-7555060e2fa0 req-7896897f-5a0f-4511-8fdb-71f85c759df7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057162 Jul 22 11:14:54.999541 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 86/160] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:14:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:14:55.077199 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-0f225f96-e448-48a9-8690-cedada5c1331 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5202e2bdba064c4aaa84e15e1f0f0dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cd35ed100244fdab3228d1afe62400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:55.091072 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-0f225f96-e448-48a9-8690-cedada5c1331 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] 10.222.0.20 "GET /compute/v2.1/servers/37f3ca38-a4e1-4c99-ace3-be7264f28e4e" status: 200 len: 1503 microversion: 2.1 time: 0.297198 Jul 22 11:14:55.092333 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 75/161] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:54 2022] GET /compute/v2.1/servers/37f3ca38-a4e1-4c99-ace3-be7264f28e4e => generated 1503 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:55.124418 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-15363323-570a-4270-810f-73f17c9c4a9a tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:55.126438 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-15363323-570a-4270-810f-73f17c9c4a9a tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 0501f722-7553-4cba-9675-7bcbabb72887] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:55.139131 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-15363323-570a-4270-810f-73f17c9c4a9a tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:55.140415 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-15363323-570a-4270-810f-73f17c9c4a9a tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:55.143143 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-15363323-570a-4270-810f-73f17c9c4a9a tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:55.144354 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-15363323-570a-4270-810f-73f17c9c4a9a tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:55.206620 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-53a8e0bd-8ce3-4b63-a280-5536ba481961 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:55.209222 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-53a8e0bd-8ce3-4b63-a280-5536ba481961 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 3108d9e0-3b2d-402a-aaab-c313c30e7900] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:55.226898 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-53a8e0bd-8ce3-4b63-a280-5536ba481961 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:55.227872 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-53a8e0bd-8ce3-4b63-a280-5536ba481961 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:55.232783 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-53a8e0bd-8ce3-4b63-a280-5536ba481961 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:55.237752 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-53a8e0bd-8ce3-4b63-a280-5536ba481961 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:55.479744 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-15363323-570a-4270-810f-73f17c9c4a9a tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:55.505514 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-15363323-570a-4270-810f-73f17c9c4a9a tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887" status: 200 len: 1366 microversion: 2.1 time: 0.393298 Jul 22 11:14:55.512803 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 87/162] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:55 2022] GET /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887 => generated 1366 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:55.549449 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-2675eae6-fe0f-4b4b-bbf8-1b63fdf557e0 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:55.550505 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-2675eae6-fe0f-4b4b-bbf8-1b63fdf557e0 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:55.568857 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-2675eae6-fe0f-4b4b-bbf8-1b63fdf557e0 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:55.569637 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-2675eae6-fe0f-4b4b-bbf8-1b63fdf557e0 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:55.571069 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-2675eae6-fe0f-4b4b-bbf8-1b63fdf557e0 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:55.571861 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-2675eae6-fe0f-4b4b-bbf8-1b63fdf557e0 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:55.626668 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-53a8e0bd-8ce3-4b63-a280-5536ba481961 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:55.642276 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-53a8e0bd-8ce3-4b63-a280-5536ba481961 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900" status: 200 len: 1516 microversion: 2.1 time: 0.441449 Jul 22 11:14:55.644192 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 76/163] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:55 2022] GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900 => generated 1516 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:55.678398 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-eda25c25-9303-4734-8a5e-bccaa0c875b5 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:14:55.682171 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-eda25c25-9303-4734-8a5e-bccaa0c875b5 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 3108d9e0-3b2d-402a-aaab-c313c30e7900] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:55.708748 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-eda25c25-9303-4734-8a5e-bccaa0c875b5 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:55.712808 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-eda25c25-9303-4734-8a5e-bccaa0c875b5 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:55.717180 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-eda25c25-9303-4734-8a5e-bccaa0c875b5 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:55.718965 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-eda25c25-9303-4734-8a5e-bccaa0c875b5 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:55.865911 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.objects.instance [None req-eda25c25-9303-4734-8a5e-bccaa0c875b5 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lazy-loading 'flavor' on Instance uuid 3108d9e0-3b2d-402a-aaab-c313c30e7900 {{(pid=117885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 22 11:14:56.314130 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-2675eae6-fe0f-4b4b-bbf8-1b63fdf557e0 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:56.320271 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-eda25c25-9303-4734-8a5e-bccaa0c875b5 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "POST /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900/action" status: 200 len: 32 microversion: 2.1 time: 0.659688 Jul 22 11:14:56.322220 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 77/164] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Jul 22 11:14:55 2022] POST /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900/action => generated 32 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 22 11:14:56.329282 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-2675eae6-fe0f-4b4b-bbf8-1b63fdf557e0 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1360 microversion: 2.1 time: 0.786921 Jul 22 11:14:56.329877 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 88/165] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:55 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1360 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:56.356958 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-583df126-5748-4191-b2e7-3664e30e2c19 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:56.358820 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-583df126-5748-4191-b2e7-3664e30e2c19 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 3108d9e0-3b2d-402a-aaab-c313c30e7900] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:56.370818 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-583df126-5748-4191-b2e7-3664e30e2c19 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:56.371994 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-583df126-5748-4191-b2e7-3664e30e2c19 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:56.374620 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-583df126-5748-4191-b2e7-3664e30e2c19 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:56.375729 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-583df126-5748-4191-b2e7-3664e30e2c19 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:56.523496 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-dd3493ca-13f7-465c-bb89-a5e2afcb3893 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:56.524113 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-dd3493ca-13f7-465c-bb89-a5e2afcb3893 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 0501f722-7553-4cba-9675-7bcbabb72887] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:56.528557 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG dbcounter [-] [117884] Writing DB stats nova_api:SELECT=94 {{(pid=117884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:14:56.539693 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-dd3493ca-13f7-465c-bb89-a5e2afcb3893 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:56.540653 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-dd3493ca-13f7-465c-bb89-a5e2afcb3893 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:56.542683 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-dd3493ca-13f7-465c-bb89-a5e2afcb3893 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:56.543582 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-dd3493ca-13f7-465c-bb89-a5e2afcb3893 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:56.685948 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-583df126-5748-4191-b2e7-3664e30e2c19 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:56.706051 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-583df126-5748-4191-b2e7-3664e30e2c19 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900" status: 200 len: 1522 microversion: 2.1 time: 0.375581 Jul 22 11:14:56.720614 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 78/166] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:56 2022] GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900 => generated 1522 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:14:56.965106 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-dd3493ca-13f7-465c-bb89-a5e2afcb3893 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:56.978299 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-dd3493ca-13f7-465c-bb89-a5e2afcb3893 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887" status: 200 len: 1366 microversion: 2.1 time: 0.458485 Jul 22 11:14:56.991985 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 89/167] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:56 2022] GET /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887 => generated 1366 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:14:57.021709 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-d8e45a63-ba91-4438-a20b-2daec295184a req-148a9263-9a77-43b3-bbe8-5afa481677d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cafe061-7a16-4c2c-8796-da7dac3f27f1", "name": "network-vif-plugged", "status": "completed", "tag": "d89d05f5-4d23-40cd-88f2-d3ff71f50ba0"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:14:57.035042 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-d8e45a63-ba91-4438-a20b-2daec295184a req-148a9263-9a77-43b3-bbe8-5afa481677d3 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:57.036417 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-d8e45a63-ba91-4438-a20b-2daec295184a req-148a9263-9a77-43b3-bbe8-5afa481677d3 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:57.051984 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-d8e45a63-ba91-4438-a20b-2daec295184a req-148a9263-9a77-43b3-bbe8-5afa481677d3 service nova] Creating event network-vif-plugged:d89d05f5-4d23-40cd-88f2-d3ff71f50ba0 for instance 1cafe061-7a16-4c2c-8796-da7dac3f27f1 on hv-cinder-84890 Jul 22 11:14:57.084863 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-d8e45a63-ba91-4438-a20b-2daec295184a req-148a9263-9a77-43b3-bbe8-5afa481677d3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066335 Jul 22 11:14:57.089837 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 79/168] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:14:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:14:57.149099 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-0b6a5b53-9310-42de-b91e-6d3bf0313fbe tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c945e8b7-1ffa-49cf-a913-9ef4011b20c0"}} {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:14:57.150967 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-0b6a5b53-9310-42de-b91e-6d3bf0313fbe tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] [instance: 37f3ca38-a4e1-4c99-ace3-be7264f28e4e] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:57.163213 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-0b6a5b53-9310-42de-b91e-6d3bf0313fbe tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:57.164158 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-0b6a5b53-9310-42de-b91e-6d3bf0313fbe tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:57.164898 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-0b6a5b53-9310-42de-b91e-6d3bf0313fbe tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:57.165736 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-0b6a5b53-9310-42de-b91e-6d3bf0313fbe tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:57.383590 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-eb1cc37c-e9bb-4bc7-a587-126c04f75b4b tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:57.388912 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-eb1cc37c-e9bb-4bc7-a587-126c04f75b4b tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:57.408829 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-eb1cc37c-e9bb-4bc7-a587-126c04f75b4b tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:57.409891 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-eb1cc37c-e9bb-4bc7-a587-126c04f75b4b tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:57.411587 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-eb1cc37c-e9bb-4bc7-a587-126c04f75b4b tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:57.412865 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-eb1cc37c-e9bb-4bc7-a587-126c04f75b4b tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:57.801944 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-eb1cc37c-e9bb-4bc7-a587-126c04f75b4b tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:57.820041 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-eb1cc37c-e9bb-4bc7-a587-126c04f75b4b tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1360 microversion: 2.1 time: 0.458363 Jul 22 11:14:57.829851 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 80/169] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:57 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1360 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:57.829851 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-f4e60d9c-39cf-4b2b-901d-4298e9da16cc tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:57.829851 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-f4e60d9c-39cf-4b2b-901d-4298e9da16cc tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 3108d9e0-3b2d-402a-aaab-c313c30e7900] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:57.874743 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f4e60d9c-39cf-4b2b-901d-4298e9da16cc tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:57.879299 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f4e60d9c-39cf-4b2b-901d-4298e9da16cc tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:57.891970 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f4e60d9c-39cf-4b2b-901d-4298e9da16cc tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:57.894670 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f4e60d9c-39cf-4b2b-901d-4298e9da16cc tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:58.156497 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-0b6a5b53-9310-42de-b91e-6d3bf0313fbe tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] 10.222.0.20 "POST /compute/v2.1/servers/37f3ca38-a4e1-4c99-ace3-be7264f28e4e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.015703 Jul 22 11:14:58.171089 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 90/170] 10.222.0.20 () {60 vars in 1322 bytes} [Fri Jul 22 11:14:57 2022] POST /compute/v2.1/servers/37f3ca38-a4e1-4c99-ace3-be7264f28e4e/os-volume_attachments => generated 194 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:14:58.188748 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-b4ff0850-398c-4e51-80ff-4ca7aeb0a84d tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:58.190955 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-b4ff0850-398c-4e51-80ff-4ca7aeb0a84d tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 0501f722-7553-4cba-9675-7bcbabb72887] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:58.215425 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-b4ff0850-398c-4e51-80ff-4ca7aeb0a84d tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:58.218207 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-b4ff0850-398c-4e51-80ff-4ca7aeb0a84d tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:58.219104 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-b4ff0850-398c-4e51-80ff-4ca7aeb0a84d tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:58.222623 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-b4ff0850-398c-4e51-80ff-4ca7aeb0a84d tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:58.528914 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-f4e60d9c-39cf-4b2b-901d-4298e9da16cc tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:58.558356 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-f4e60d9c-39cf-4b2b-901d-4298e9da16cc tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900" status: 200 len: 1522 microversion: 2.1 time: 0.733222 Jul 22 11:14:58.564803 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 81/171] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:57 2022] GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900 => generated 1522 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:58.577603 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-b4ff0850-398c-4e51-80ff-4ca7aeb0a84d tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:58.577603 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-b4ff0850-398c-4e51-80ff-4ca7aeb0a84d tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887" status: 200 len: 1366 microversion: 2.1 time: 0.404099 Jul 22 11:14:58.578174 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 91/172] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:58 2022] GET /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887 => generated 1366 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:58.845698 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-8c718006-51f1-4212-9ab6-abf066099b71 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:58.849019 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-8c718006-51f1-4212-9ab6-abf066099b71 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:58.878692 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-8c718006-51f1-4212-9ab6-abf066099b71 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:58.882108 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-8c718006-51f1-4212-9ab6-abf066099b71 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:58.883571 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-8c718006-51f1-4212-9ab6-abf066099b71 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:58.886569 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-8c718006-51f1-4212-9ab6-abf066099b71 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:58.945557 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG dbcounter [-] [117884] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:14:59.199449 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-8c718006-51f1-4212-9ab6-abf066099b71 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:14:59.212777 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-8c718006-51f1-4212-9ab6-abf066099b71 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1360 microversion: 2.1 time: 0.377198 Jul 22 11:14:59.213747 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 92/173] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:58 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1360 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:14:59.600301 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-318baeb7-7e41-4a2f-8f7a-1bc432028ffd tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:59.601049 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-318baeb7-7e41-4a2f-8f7a-1bc432028ffd tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 0501f722-7553-4cba-9675-7bcbabb72887] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:59.603534 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-2f5c85b2-2548-488f-bc3c-3ccdd5dbb270 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:14:59.612948 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-2f5c85b2-2548-488f-bc3c-3ccdd5dbb270 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 3108d9e0-3b2d-402a-aaab-c313c30e7900] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:14:59.617253 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-318baeb7-7e41-4a2f-8f7a-1bc432028ffd tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:59.623535 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-318baeb7-7e41-4a2f-8f7a-1bc432028ffd tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:59.625437 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-318baeb7-7e41-4a2f-8f7a-1bc432028ffd tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:59.630372 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-318baeb7-7e41-4a2f-8f7a-1bc432028ffd tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:59.721054 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2f5c85b2-2548-488f-bc3c-3ccdd5dbb270 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:59.722294 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2f5c85b2-2548-488f-bc3c-3ccdd5dbb270 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:14:59.729619 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2f5c85b2-2548-488f-bc3c-3ccdd5dbb270 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:14:59.730957 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2f5c85b2-2548-488f-bc3c-3ccdd5dbb270 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:00.029150 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-2f5c85b2-2548-488f-bc3c-3ccdd5dbb270 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:15:00.045995 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-2f5c85b2-2548-488f-bc3c-3ccdd5dbb270 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900" status: 200 len: 1522 microversion: 2.1 time: 0.452714 Jul 22 11:15:00.048353 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 82/174] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:59 2022] GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900 => generated 1522 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:15:00.068032 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-318baeb7-7e41-4a2f-8f7a-1bc432028ffd tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:15:00.081626 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-318baeb7-7e41-4a2f-8f7a-1bc432028ffd tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887" status: 200 len: 1366 microversion: 2.1 time: 0.487834 Jul 22 11:15:00.082643 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 93/175] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:14:59 2022] GET /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887 => generated 1366 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:15:00.254615 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-2b5fb268-895b-4793-9d47-b65020601755 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:15:00.255776 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-2b5fb268-895b-4793-9d47-b65020601755 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:15:00.298017 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2b5fb268-895b-4793-9d47-b65020601755 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:00.298376 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2b5fb268-895b-4793-9d47-b65020601755 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:00.301673 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2b5fb268-895b-4793-9d47-b65020601755 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:00.302486 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2b5fb268-895b-4793-9d47-b65020601755 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:00.392489 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:15:00.692820 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-2b5fb268-895b-4793-9d47-b65020601755 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:15:00.707054 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-2b5fb268-895b-4793-9d47-b65020601755 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1360 microversion: 2.1 time: 0.466276 Jul 22 11:15:00.708158 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 83/176] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:15:00 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1360 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:15:01.078773 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-bfea8706-9e66-4c08-a8ea-083ccfd42ac0 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:15:01.080039 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-bfea8706-9e66-4c08-a8ea-083ccfd42ac0 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 3108d9e0-3b2d-402a-aaab-c313c30e7900] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:15:01.091138 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-bfea8706-9e66-4c08-a8ea-083ccfd42ac0 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:01.092122 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-bfea8706-9e66-4c08-a8ea-083ccfd42ac0 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:01.093620 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-bfea8706-9e66-4c08-a8ea-083ccfd42ac0 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:01.094962 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-bfea8706-9e66-4c08-a8ea-083ccfd42ac0 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:01.105443 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-e728f202-0d26-401d-990d-4511173ab6d6 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:15:01.106644 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-e728f202-0d26-401d-990d-4511173ab6d6 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 0501f722-7553-4cba-9675-7bcbabb72887] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:15:01.118486 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e728f202-0d26-401d-990d-4511173ab6d6 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:01.119760 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e728f202-0d26-401d-990d-4511173ab6d6 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:01.121462 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e728f202-0d26-401d-990d-4511173ab6d6 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:01.123035 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e728f202-0d26-401d-990d-4511173ab6d6 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:01.340372 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-bfea8706-9e66-4c08-a8ea-083ccfd42ac0 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:15:01.341430 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-e728f202-0d26-401d-990d-4511173ab6d6 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:15:01.349213 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-bfea8706-9e66-4c08-a8ea-083ccfd42ac0 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900" status: 200 len: 1522 microversion: 2.1 time: 0.278755 Jul 22 11:15:01.351348 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 94/177] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:15:01 2022] GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900 => generated 1522 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:15:01.362330 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-e728f202-0d26-401d-990d-4511173ab6d6 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887" status: 200 len: 1557 microversion: 2.1 time: 0.263809 Jul 22 11:15:01.363500 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 84/178] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:15:01 2022] GET /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887 => generated 1557 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:15:01.406498 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-99e7e032-b085-4d15-b07d-6da44a864b8d tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:15:01.407907 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-99e7e032-b085-4d15-b07d-6da44a864b8d tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 0501f722-7553-4cba-9675-7bcbabb72887] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:15:01.418703 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-99e7e032-b085-4d15-b07d-6da44a864b8d tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:01.419500 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-99e7e032-b085-4d15-b07d-6da44a864b8d tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:01.420744 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-99e7e032-b085-4d15-b07d-6da44a864b8d tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:01.421490 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-99e7e032-b085-4d15-b07d-6da44a864b8d tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:01.563018 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-99e7e032-b085-4d15-b07d-6da44a864b8d tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.174472 Jul 22 11:15:01.564192 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 95/179] 10.222.0.20 () {58 vars in 1274 bytes} [Fri Jul 22 11:15:01 2022] GET /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887/os-interface => generated 285 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:15:01.739642 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-a81f6239-4c6c-41cd-a937-6418c0589af8 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:15:01.741663 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-a81f6239-4c6c-41cd-a937-6418c0589af8 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:15:01.756057 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a81f6239-4c6c-41cd-a937-6418c0589af8 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:01.756913 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a81f6239-4c6c-41cd-a937-6418c0589af8 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:01.759543 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a81f6239-4c6c-41cd-a937-6418c0589af8 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:01.760422 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a81f6239-4c6c-41cd-a937-6418c0589af8 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:02.155303 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-a81f6239-4c6c-41cd-a937-6418c0589af8 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:15:02.181352 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-a81f6239-4c6c-41cd-a937-6418c0589af8 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1360 microversion: 2.1 time: 0.450822 Jul 22 11:15:02.182406 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 85/180] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:15:01 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1360 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:15:02.367574 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-2b6d1348-2bbe-42a8-8325-0e81eaccc812 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:15:02.368172 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-2b6d1348-2bbe-42a8-8325-0e81eaccc812 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 3108d9e0-3b2d-402a-aaab-c313c30e7900] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:15:02.375047 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-2b6d1348-2bbe-42a8-8325-0e81eaccc812 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:02.375654 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-2b6d1348-2bbe-42a8-8325-0e81eaccc812 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:02.376430 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-2b6d1348-2bbe-42a8-8325-0e81eaccc812 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:02.376856 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-2b6d1348-2bbe-42a8-8325-0e81eaccc812 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:02.645271 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-2b6d1348-2bbe-42a8-8325-0e81eaccc812 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:15:02.657129 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-2b6d1348-2bbe-42a8-8325-0e81eaccc812 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900" status: 200 len: 1522 microversion: 2.1 time: 0.293960 Jul 22 11:15:02.658054 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 96/181] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:15:02 2022] GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900 => generated 1522 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:15:03.211943 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-b9bdf7d9-707f-4590-b60f-8e69f3f07e30 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:15:03.213017 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-b9bdf7d9-707f-4590-b60f-8e69f3f07e30 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:15:03.223961 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b9bdf7d9-707f-4590-b60f-8e69f3f07e30 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:03.225197 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b9bdf7d9-707f-4590-b60f-8e69f3f07e30 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:03.226843 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b9bdf7d9-707f-4590-b60f-8e69f3f07e30 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:03.227934 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b9bdf7d9-707f-4590-b60f-8e69f3f07e30 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:03.503736 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-b9bdf7d9-707f-4590-b60f-8e69f3f07e30 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:15:03.525133 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-b9bdf7d9-707f-4590-b60f-8e69f3f07e30 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1360 microversion: 2.1 time: 0.319837 Jul 22 11:15:03.526634 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 86/182] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:15:03 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1360 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:15:03.681958 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-00f71c48-faa6-4677-a022-7313fdb07e0f tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:15:03.682972 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-00f71c48-faa6-4677-a022-7313fdb07e0f tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 3108d9e0-3b2d-402a-aaab-c313c30e7900] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:15:03.705836 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-00f71c48-faa6-4677-a022-7313fdb07e0f tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:03.707560 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-00f71c48-faa6-4677-a022-7313fdb07e0f tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:03.713431 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-00f71c48-faa6-4677-a022-7313fdb07e0f tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:03.714867 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-00f71c48-faa6-4677-a022-7313fdb07e0f tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:03.732317 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-857dc4f2-e1ac-49d7-9334-8a334c7ad2c5 req-52a13f23-a5c2-4d10-a44b-4e5411eaa647 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0501f722-7553-4cba-9675-7bcbabb72887", "tag": "3c9a61a2-8eae-42fd-91d8-ee04df69941e"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:15:03.764242 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-857dc4f2-e1ac-49d7-9334-8a334c7ad2c5 req-52a13f23-a5c2-4d10-a44b-4e5411eaa647 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:03.766409 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-857dc4f2-e1ac-49d7-9334-8a334c7ad2c5 req-52a13f23-a5c2-4d10-a44b-4e5411eaa647 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:03.795745 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-857dc4f2-e1ac-49d7-9334-8a334c7ad2c5 req-52a13f23-a5c2-4d10-a44b-4e5411eaa647 service nova] Creating event network-changed:3c9a61a2-8eae-42fd-91d8-ee04df69941e for instance 0501f722-7553-4cba-9675-7bcbabb72887 on hv-cinder-84890 Jul 22 11:15:03.807226 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-857dc4f2-e1ac-49d7-9334-8a334c7ad2c5 req-52a13f23-a5c2-4d10-a44b-4e5411eaa647 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077456 Jul 22 11:15:03.815710 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 87/183] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:15:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 22 11:15:04.200091 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-00f71c48-faa6-4677-a022-7313fdb07e0f tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:15:04.209772 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-00f71c48-faa6-4677-a022-7313fdb07e0f tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900" status: 200 len: 1522 microversion: 2.1 time: 0.534868 Jul 22 11:15:04.210620 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 97/184] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:15:03 2022] GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900 => generated 1522 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:15:04.556614 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-8f457e50-8f1d-48ad-9801-e6f4a3045ab2 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:15:04.557722 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-8f457e50-8f1d-48ad-9801-e6f4a3045ab2 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:15:04.566935 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8f457e50-8f1d-48ad-9801-e6f4a3045ab2 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:04.567439 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8f457e50-8f1d-48ad-9801-e6f4a3045ab2 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:04.568213 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8f457e50-8f1d-48ad-9801-e6f4a3045ab2 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:04.568640 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8f457e50-8f1d-48ad-9801-e6f4a3045ab2 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:04.886933 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-8f457e50-8f1d-48ad-9801-e6f4a3045ab2 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:15:04.902849 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-8f457e50-8f1d-48ad-9801-e6f4a3045ab2 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1360 microversion: 2.1 time: 0.354800 Jul 22 11:15:04.903853 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 88/185] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:15:04 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1360 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:15:05.232486 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-55c008f4-67be-4b33-93a2-43e9763d9ae4 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:15:05.233272 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-55c008f4-67be-4b33-93a2-43e9763d9ae4 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 3108d9e0-3b2d-402a-aaab-c313c30e7900] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:15:05.242156 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-55c008f4-67be-4b33-93a2-43e9763d9ae4 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:05.242601 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-55c008f4-67be-4b33-93a2-43e9763d9ae4 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:05.243391 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-55c008f4-67be-4b33-93a2-43e9763d9ae4 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:05.243816 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-55c008f4-67be-4b33-93a2-43e9763d9ae4 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:05.513104 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-55c008f4-67be-4b33-93a2-43e9763d9ae4 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:15:05.534843 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-55c008f4-67be-4b33-93a2-43e9763d9ae4 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900" status: 200 len: 1522 microversion: 2.1 time: 0.306690 Jul 22 11:15:05.551900 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 98/186] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:15:05 2022] GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900 => generated 1522 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:15:05.926863 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-94db5d71-865b-4c4c-aa2f-366b5cf6f327 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:15:05.950626 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-94db5d71-865b-4c4c-aa2f-366b5cf6f327 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:15:05.965871 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-94db5d71-865b-4c4c-aa2f-366b5cf6f327 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:05.967157 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-94db5d71-865b-4c4c-aa2f-366b5cf6f327 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:05.969620 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-94db5d71-865b-4c4c-aa2f-366b5cf6f327 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:05.970709 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-94db5d71-865b-4c4c-aa2f-366b5cf6f327 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:06.181265 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-94db5d71-865b-4c4c-aa2f-366b5cf6f327 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:15:06.189787 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-94db5d71-865b-4c4c-aa2f-366b5cf6f327 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1546 microversion: 2.1 time: 0.272239 Jul 22 11:15:06.190388 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 89/187] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:15:05 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1546 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:15:06.214745 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-598d7f3c-4dc2-495c-8e08-e6c54738b91c tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:15:06.215233 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-598d7f3c-4dc2-495c-8e08-e6c54738b91c tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:15:06.222433 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-598d7f3c-4dc2-495c-8e08-e6c54738b91c tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:06.222981 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-598d7f3c-4dc2-495c-8e08-e6c54738b91c tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:06.223940 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-598d7f3c-4dc2-495c-8e08-e6c54738b91c tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:06.224468 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-598d7f3c-4dc2-495c-8e08-e6c54738b91c tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:06.340154 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-598d7f3c-4dc2-495c-8e08-e6c54738b91c tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.128854 Jul 22 11:15:06.341562 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 99/188] 10.222.0.20 () {58 vars in 1274 bytes} [Fri Jul 22 11:15:06 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1/os-interface => generated 284 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:15:06.561255 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-d5b23a35-b7da-4471-8cb1-9d9dda626e3c tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:15:06.562104 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-d5b23a35-b7da-4471-8cb1-9d9dda626e3c tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 3108d9e0-3b2d-402a-aaab-c313c30e7900] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:15:06.568922 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d5b23a35-b7da-4471-8cb1-9d9dda626e3c tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:06.569364 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d5b23a35-b7da-4471-8cb1-9d9dda626e3c tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:06.570127 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d5b23a35-b7da-4471-8cb1-9d9dda626e3c tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:06.570553 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d5b23a35-b7da-4471-8cb1-9d9dda626e3c tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:06.823098 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-d5b23a35-b7da-4471-8cb1-9d9dda626e3c tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:15:06.836726 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-d5b23a35-b7da-4471-8cb1-9d9dda626e3c tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900" status: 200 len: 1522 microversion: 2.1 time: 0.279458 Jul 22 11:15:06.850346 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 90/189] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:15:06 2022] GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900 => generated 1522 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:15:07.862459 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-b604a545-0475-439f-bcaa-9cf93bd197db tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:15:07.863385 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-b604a545-0475-439f-bcaa-9cf93bd197db tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 3108d9e0-3b2d-402a-aaab-c313c30e7900] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:15:07.877355 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-b604a545-0475-439f-bcaa-9cf93bd197db tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:07.877795 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-b604a545-0475-439f-bcaa-9cf93bd197db tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:07.878572 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-b604a545-0475-439f-bcaa-9cf93bd197db tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:07.878999 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-b604a545-0475-439f-bcaa-9cf93bd197db tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:07.909823 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-d39ae390-5ff8-41e3-bcef-06e634b63405 req-a7e77419-8cc7-4321-bbf3-0db23cb584bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cafe061-7a16-4c2c-8796-da7dac3f27f1", "tag": "d89d05f5-4d23-40cd-88f2-d3ff71f50ba0"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:15:07.946478 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-d39ae390-5ff8-41e3-bcef-06e634b63405 req-a7e77419-8cc7-4321-bbf3-0db23cb584bd service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:07.947140 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-d39ae390-5ff8-41e3-bcef-06e634b63405 req-a7e77419-8cc7-4321-bbf3-0db23cb584bd service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:07.975075 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-d39ae390-5ff8-41e3-bcef-06e634b63405 req-a7e77419-8cc7-4321-bbf3-0db23cb584bd service nova] Creating event network-changed:d89d05f5-4d23-40cd-88f2-d3ff71f50ba0 for instance 1cafe061-7a16-4c2c-8796-da7dac3f27f1 on hv-cinder-84890 Jul 22 11:15:07.983092 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-d39ae390-5ff8-41e3-bcef-06e634b63405 req-a7e77419-8cc7-4321-bbf3-0db23cb584bd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080093 Jul 22 11:15:07.983884 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 91/190] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:15:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:15:08.062829 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-b604a545-0475-439f-bcaa-9cf93bd197db tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:15:08.072929 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-b604a545-0475-439f-bcaa-9cf93bd197db tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900" status: 200 len: 1522 microversion: 2.1 time: 0.215351 Jul 22 11:15:08.073686 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 100/191] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:15:07 2022] GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900 => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:15:09.098263 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-342b99d9-27e3-490b-9555-343e44986d2f tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:15:09.098960 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-342b99d9-27e3-490b-9555-343e44986d2f tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 3108d9e0-3b2d-402a-aaab-c313c30e7900] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:15:09.105727 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-342b99d9-27e3-490b-9555-343e44986d2f tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:09.106165 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-342b99d9-27e3-490b-9555-343e44986d2f tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:09.106932 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-342b99d9-27e3-490b-9555-343e44986d2f tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:09.107386 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-342b99d9-27e3-490b-9555-343e44986d2f tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:09.269788 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-342b99d9-27e3-490b-9555-343e44986d2f tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:15:09.283900 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-342b99d9-27e3-490b-9555-343e44986d2f tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900" status: 200 len: 1522 microversion: 2.1 time: 0.190067 Jul 22 11:15:09.284902 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 92/192] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:15:09 2022] GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900 => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:15:10.302230 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-bd0fcb76-6011-46a6-a3c4-c53d2f3f3231 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:15:10.303020 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-bd0fcb76-6011-46a6-a3c4-c53d2f3f3231 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 3108d9e0-3b2d-402a-aaab-c313c30e7900] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:15:10.318757 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-bd0fcb76-6011-46a6-a3c4-c53d2f3f3231 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:10.319628 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-bd0fcb76-6011-46a6-a3c4-c53d2f3f3231 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:10.321558 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-bd0fcb76-6011-46a6-a3c4-c53d2f3f3231 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:10.321720 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-bd0fcb76-6011-46a6-a3c4-c53d2f3f3231 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:10.623547 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-bd0fcb76-6011-46a6-a3c4-c53d2f3f3231 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:15:10.644085 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-bd0fcb76-6011-46a6-a3c4-c53d2f3f3231 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900" status: 200 len: 1522 microversion: 2.1 time: 0.344968 Jul 22 11:15:10.646523 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 101/193] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:15:10 2022] GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900 => generated 1522 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:15:11.682555 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-e4a0c291-f7e1-46b3-bf75-e5adb5d48e0a tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:15:11.683636 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-e4a0c291-f7e1-46b3-bf75-e5adb5d48e0a tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 3108d9e0-3b2d-402a-aaab-c313c30e7900] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:15:11.693575 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e4a0c291-f7e1-46b3-bf75-e5adb5d48e0a tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:11.695338 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e4a0c291-f7e1-46b3-bf75-e5adb5d48e0a tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:11.695963 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e4a0c291-f7e1-46b3-bf75-e5adb5d48e0a tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:11.696669 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e4a0c291-f7e1-46b3-bf75-e5adb5d48e0a tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:11.916780 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-e4a0c291-f7e1-46b3-bf75-e5adb5d48e0a tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:15:11.930416 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-e4a0c291-f7e1-46b3-bf75-e5adb5d48e0a tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900" status: 200 len: 1522 microversion: 2.1 time: 0.254609 Jul 22 11:15:11.932094 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 93/194] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:15:11 2022] GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900 => generated 1522 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:15:12.956990 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-546ff9d7-1305-4357-8de1-b92626e31ea3 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:15:12.958008 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-546ff9d7-1305-4357-8de1-b92626e31ea3 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 3108d9e0-3b2d-402a-aaab-c313c30e7900] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:15:12.974250 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-546ff9d7-1305-4357-8de1-b92626e31ea3 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:12.974822 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-546ff9d7-1305-4357-8de1-b92626e31ea3 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:12.975914 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-546ff9d7-1305-4357-8de1-b92626e31ea3 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:12.976499 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-546ff9d7-1305-4357-8de1-b92626e31ea3 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:13.276403 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-546ff9d7-1305-4357-8de1-b92626e31ea3 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:15:13.287841 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-546ff9d7-1305-4357-8de1-b92626e31ea3 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900" status: 200 len: 1522 microversion: 2.1 time: 0.337133 Jul 22 11:15:13.288920 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 102/195] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:15:12 2022] GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900 => generated 1522 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:15:14.307377 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-3ba9b688-d55d-44f0-b759-bb0795366f8b tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:15:14.308212 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-3ba9b688-d55d-44f0-b759-bb0795366f8b tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 3108d9e0-3b2d-402a-aaab-c313c30e7900] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:15:14.319396 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3ba9b688-d55d-44f0-b759-bb0795366f8b tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:14.322003 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3ba9b688-d55d-44f0-b759-bb0795366f8b tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:14.323528 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3ba9b688-d55d-44f0-b759-bb0795366f8b tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:14.324125 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3ba9b688-d55d-44f0-b759-bb0795366f8b tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:14.671716 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-3ba9b688-d55d-44f0-b759-bb0795366f8b tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:15:14.697449 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-3ba9b688-d55d-44f0-b759-bb0795366f8b tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900" status: 200 len: 1522 microversion: 2.1 time: 0.393543 Jul 22 11:15:14.704387 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 94/196] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:15:14 2022] GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900 => generated 1522 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:15:15.739554 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-6853ca3f-78f6-43f7-9605-a7d50a5e7ec5 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:15:15.742441 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-6853ca3f-78f6-43f7-9605-a7d50a5e7ec5 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 3108d9e0-3b2d-402a-aaab-c313c30e7900] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:15:15.755214 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-6853ca3f-78f6-43f7-9605-a7d50a5e7ec5 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:15.755874 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-6853ca3f-78f6-43f7-9605-a7d50a5e7ec5 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:15.756911 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-6853ca3f-78f6-43f7-9605-a7d50a5e7ec5 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:15.757478 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-6853ca3f-78f6-43f7-9605-a7d50a5e7ec5 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:16.016371 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-6853ca3f-78f6-43f7-9605-a7d50a5e7ec5 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:15:16.041076 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-6853ca3f-78f6-43f7-9605-a7d50a5e7ec5 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900" status: 200 len: 1522 microversion: 2.1 time: 0.307714 Jul 22 11:15:16.048481 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 103/197] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:15:15 2022] GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900 => generated 1522 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:15:17.066784 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-18d932c1-655b-409d-86ca-89a53e782049 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:15:17.067928 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-18d932c1-655b-409d-86ca-89a53e782049 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 3108d9e0-3b2d-402a-aaab-c313c30e7900] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:15:17.079165 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-18d932c1-655b-409d-86ca-89a53e782049 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:17.079786 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-18d932c1-655b-409d-86ca-89a53e782049 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:17.080912 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-18d932c1-655b-409d-86ca-89a53e782049 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:17.081595 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-18d932c1-655b-409d-86ca-89a53e782049 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:17.273378 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-18d932c1-655b-409d-86ca-89a53e782049 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:15:17.282371 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-18d932c1-655b-409d-86ca-89a53e782049 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900" status: 200 len: 1522 microversion: 2.1 time: 0.222757 Jul 22 11:15:17.283124 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 95/198] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:15:17 2022] GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900 => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:15:18.077504 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-896e1903-9df7-4729-8a33-3f34882ddace tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:15:18.078436 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-896e1903-9df7-4729-8a33-3f34882ddace tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] [instance: 37f3ca38-a4e1-4c99-ace3-be7264f28e4e] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:15:18.085257 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-896e1903-9df7-4729-8a33-3f34882ddace tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:18.085708 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-896e1903-9df7-4729-8a33-3f34882ddace tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:18.086501 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-896e1903-9df7-4729-8a33-3f34882ddace tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:18.086939 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-896e1903-9df7-4729-8a33-3f34882ddace tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:18.119721 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-896e1903-9df7-4729-8a33-3f34882ddace tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] [instance: 37f3ca38-a4e1-4c99-ace3-be7264f28e4e] Going to try to terminate instance {{(pid=117884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 22 11:15:18.237265 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-896e1903-9df7-4729-8a33-3f34882ddace tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] 10.222.0.20 "DELETE /compute/v2.1/servers/37f3ca38-a4e1-4c99-ace3-be7264f28e4e" status: 204 len: 0 microversion: 2.1 time: 0.163152 Jul 22 11:15:18.238196 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 104/199] 10.222.0.20 () {58 vars in 1238 bytes} [Fri Jul 22 11:15:18 2022] DELETE /compute/v2.1/servers/37f3ca38-a4e1-4c99-ace3-be7264f28e4e => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 22 11:15:18.255250 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-f5074d98-2da5-41c4-bad5-3c92a882435a tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:15:18.256277 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-f5074d98-2da5-41c4-bad5-3c92a882435a tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] [instance: 37f3ca38-a4e1-4c99-ace3-be7264f28e4e] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:15:18.264012 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f5074d98-2da5-41c4-bad5-3c92a882435a tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:18.264486 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f5074d98-2da5-41c4-bad5-3c92a882435a tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:18.265304 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f5074d98-2da5-41c4-bad5-3c92a882435a tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:18.265727 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f5074d98-2da5-41c4-bad5-3c92a882435a tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:18.312972 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-9ee31d99-cd36-45e3-b141-f33f1e16ca65 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:15:18.314263 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-9ee31d99-cd36-45e3-b141-f33f1e16ca65 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 3108d9e0-3b2d-402a-aaab-c313c30e7900] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:15:18.324413 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-9ee31d99-cd36-45e3-b141-f33f1e16ca65 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:18.325581 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-9ee31d99-cd36-45e3-b141-f33f1e16ca65 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:18.326997 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-9ee31d99-cd36-45e3-b141-f33f1e16ca65 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:18.327835 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-9ee31d99-cd36-45e3-b141-f33f1e16ca65 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:18.460880 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-f5074d98-2da5-41c4-bad5-3c92a882435a tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5202e2bdba064c4aaa84e15e1f0f0dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cd35ed100244fdab3228d1afe62400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:15:18.472957 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-f5074d98-2da5-41c4-bad5-3c92a882435a tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] 10.222.0.20 "GET /compute/v2.1/servers/37f3ca38-a4e1-4c99-ace3-be7264f28e4e" status: 200 len: 1555 microversion: 2.1 time: 0.226544 Jul 22 11:15:18.473700 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 96/200] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:15:18 2022] GET /compute/v2.1/servers/37f3ca38-a4e1-4c99-ace3-be7264f28e4e => generated 1555 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:15:18.542562 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-9ee31d99-cd36-45e3-b141-f33f1e16ca65 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:15:18.554398 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-9ee31d99-cd36-45e3-b141-f33f1e16ca65 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900" status: 200 len: 1522 microversion: 2.1 time: 0.250740 Jul 22 11:15:18.555160 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 105/201] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:15:18 2022] GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900 => generated 1522 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:15:19.490889 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-79d37c1d-e651-4032-9384-5fa070b673f4 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:15:19.491727 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-79d37c1d-e651-4032-9384-5fa070b673f4 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] [instance: 37f3ca38-a4e1-4c99-ace3-be7264f28e4e] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:15:19.498779 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-79d37c1d-e651-4032-9384-5fa070b673f4 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:19.499673 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-79d37c1d-e651-4032-9384-5fa070b673f4 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:19.500663 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-79d37c1d-e651-4032-9384-5fa070b673f4 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:19.501206 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-79d37c1d-e651-4032-9384-5fa070b673f4 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:19.582471 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-4f9b51ab-35b7-4df2-8c3b-209c8f54cec6 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:15:19.583925 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-4f9b51ab-35b7-4df2-8c3b-209c8f54cec6 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 3108d9e0-3b2d-402a-aaab-c313c30e7900] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:15:19.596090 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-4f9b51ab-35b7-4df2-8c3b-209c8f54cec6 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:19.596892 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-4f9b51ab-35b7-4df2-8c3b-209c8f54cec6 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:19.598247 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-4f9b51ab-35b7-4df2-8c3b-209c8f54cec6 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:19.598884 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-4f9b51ab-35b7-4df2-8c3b-209c8f54cec6 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:19.668535 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-79d37c1d-e651-4032-9384-5fa070b673f4 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5202e2bdba064c4aaa84e15e1f0f0dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cd35ed100244fdab3228d1afe62400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:15:19.678010 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-79d37c1d-e651-4032-9384-5fa070b673f4 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] 10.222.0.20 "GET /compute/v2.1/servers/37f3ca38-a4e1-4c99-ace3-be7264f28e4e" status: 200 len: 1555 microversion: 2.1 time: 0.191430 Jul 22 11:15:19.678767 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 97/202] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:15:19 2022] GET /compute/v2.1/servers/37f3ca38-a4e1-4c99-ace3-be7264f28e4e => generated 1555 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:15:19.786531 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-4f9b51ab-35b7-4df2-8c3b-209c8f54cec6 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:15:19.803031 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-4f9b51ab-35b7-4df2-8c3b-209c8f54cec6 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900" status: 200 len: 1522 microversion: 2.1 time: 0.227064 Jul 22 11:15:19.804927 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 106/203] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:15:19 2022] GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900 => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:15:20.705521 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-f51e82ee-85bd-442f-b2bd-585178fce749 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:15:20.706030 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-f51e82ee-85bd-442f-b2bd-585178fce749 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] [instance: 37f3ca38-a4e1-4c99-ace3-be7264f28e4e] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:15:20.709076 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_api:SELECT=62 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:15:20.719432 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f51e82ee-85bd-442f-b2bd-585178fce749 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:20.720182 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f51e82ee-85bd-442f-b2bd-585178fce749 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:20.721506 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f51e82ee-85bd-442f-b2bd-585178fce749 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:20.722246 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f51e82ee-85bd-442f-b2bd-585178fce749 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:20.829051 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-527817eb-d3a3-49ce-8c99-085f9e27e117 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:15:20.830233 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-527817eb-d3a3-49ce-8c99-085f9e27e117 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 3108d9e0-3b2d-402a-aaab-c313c30e7900] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:15:20.838926 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-527817eb-d3a3-49ce-8c99-085f9e27e117 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:20.839422 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-527817eb-d3a3-49ce-8c99-085f9e27e117 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:20.840249 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-527817eb-d3a3-49ce-8c99-085f9e27e117 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:20.840665 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-527817eb-d3a3-49ce-8c99-085f9e27e117 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:21.020110 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-f51e82ee-85bd-442f-b2bd-585178fce749 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5202e2bdba064c4aaa84e15e1f0f0dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cd35ed100244fdab3228d1afe62400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:15:21.028355 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-527817eb-d3a3-49ce-8c99-085f9e27e117 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:15:21.034966 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-f51e82ee-85bd-442f-b2bd-585178fce749 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] 10.222.0.20 "GET /compute/v2.1/servers/37f3ca38-a4e1-4c99-ace3-be7264f28e4e" status: 200 len: 1555 microversion: 2.1 time: 0.338667 Jul 22 11:15:21.035930 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 98/204] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:15:20 2022] GET /compute/v2.1/servers/37f3ca38-a4e1-4c99-ace3-be7264f28e4e => generated 1555 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:15:21.037866 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-527817eb-d3a3-49ce-8c99-085f9e27e117 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900" status: 200 len: 1522 microversion: 2.1 time: 0.213969 Jul 22 11:15:21.038715 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 107/205] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:15:20 2022] GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900 => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:15:22.055434 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-f20125fb-6a7b-499c-8a06-4cc79bb70a9a tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:15:22.056309 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-b8e0d242-662d-443b-9367-24f9a94e5d9a tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:15:22.056309 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-b8e0d242-662d-443b-9367-24f9a94e5d9a tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 3108d9e0-3b2d-402a-aaab-c313c30e7900] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:15:22.057920 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-f20125fb-6a7b-499c-8a06-4cc79bb70a9a tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] [instance: 37f3ca38-a4e1-4c99-ace3-be7264f28e4e] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:15:22.066374 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b8e0d242-662d-443b-9367-24f9a94e5d9a tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:22.067598 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b8e0d242-662d-443b-9367-24f9a94e5d9a tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:22.069493 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b8e0d242-662d-443b-9367-24f9a94e5d9a tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:22.070304 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b8e0d242-662d-443b-9367-24f9a94e5d9a tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:22.077305 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f20125fb-6a7b-499c-8a06-4cc79bb70a9a tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:22.078474 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f20125fb-6a7b-499c-8a06-4cc79bb70a9a tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:22.089530 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f20125fb-6a7b-499c-8a06-4cc79bb70a9a tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:22.090261 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f20125fb-6a7b-499c-8a06-4cc79bb70a9a tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:22.172563 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG dbcounter [-] [117884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:15:22.254232 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-f20125fb-6a7b-499c-8a06-4cc79bb70a9a tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5202e2bdba064c4aaa84e15e1f0f0dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cd35ed100244fdab3228d1afe62400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:15:22.265538 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-f20125fb-6a7b-499c-8a06-4cc79bb70a9a tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] 10.222.0.20 "GET /compute/v2.1/servers/37f3ca38-a4e1-4c99-ace3-be7264f28e4e" status: 200 len: 1513 microversion: 2.1 time: 0.214658 Jul 22 11:15:22.266701 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 108/206] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:15:22 2022] GET /compute/v2.1/servers/37f3ca38-a4e1-4c99-ace3-be7264f28e4e => generated 1513 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:15:22.271411 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [req-5a8eb365-0476-43af-a2e1-0bb3c85bae59 req-2997f361-863e-45b0-96c8-b23153f51b8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37f3ca38-a4e1-4c99-ace3-be7264f28e4e", "name": "network-vif-deleted", "tag": "65b00a5d-a3ec-4ac4-81fb-4c9f29a071f8"}]} {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:15:22.277361 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-b8e0d242-662d-443b-9367-24f9a94e5d9a tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:15:22.290401 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-b8e0d242-662d-443b-9367-24f9a94e5d9a tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900" status: 200 len: 1522 microversion: 2.1 time: 0.239498 Jul 22 11:15:22.291163 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 99/207] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:15:22 2022] GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900 => generated 1522 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:15:22.293188 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-5a8eb365-0476-43af-a2e1-0bb3c85bae59 req-2997f361-863e-45b0-96c8-b23153f51b8c service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:22.293621 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-5a8eb365-0476-43af-a2e1-0bb3c85bae59 req-2997f361-863e-45b0-96c8-b23153f51b8c service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:22.306689 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.compute.server_external_events [req-5a8eb365-0476-43af-a2e1-0bb3c85bae59 req-2997f361-863e-45b0-96c8-b23153f51b8c service nova] Creating event network-vif-deleted:65b00a5d-a3ec-4ac4-81fb-4c9f29a071f8 for instance 37f3ca38-a4e1-4c99-ace3-be7264f28e4e on hv-cinder-84890 Jul 22 11:15:22.312223 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [req-5a8eb365-0476-43af-a2e1-0bb3c85bae59 req-2997f361-863e-45b0-96c8-b23153f51b8c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044010 Jul 22 11:15:22.313595 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 109/208] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:15:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:15:23.291680 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-99c9c3c4-7b43-4c75-a51d-fcc390e0f087 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:15:23.292452 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-99c9c3c4-7b43-4c75-a51d-fcc390e0f087 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] [instance: 37f3ca38-a4e1-4c99-ace3-be7264f28e4e] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:15:23.299284 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-99c9c3c4-7b43-4c75-a51d-fcc390e0f087 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:23.299975 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-99c9c3c4-7b43-4c75-a51d-fcc390e0f087 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:23.300815 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-99c9c3c4-7b43-4c75-a51d-fcc390e0f087 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:23.301462 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-99c9c3c4-7b43-4c75-a51d-fcc390e0f087 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:23.331046 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-0174c603-beea-48b4-8792-b9144f471a4a tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:15:23.332580 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-0174c603-beea-48b4-8792-b9144f471a4a tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 3108d9e0-3b2d-402a-aaab-c313c30e7900] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:15:23.350854 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-0174c603-beea-48b4-8792-b9144f471a4a tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:23.351966 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-99c9c3c4-7b43-4c75-a51d-fcc390e0f087 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:23.353503 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-99c9c3c4-7b43-4c75-a51d-fcc390e0f087 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:23.354743 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.objects.instance [None req-99c9c3c4-7b43-4c75-a51d-fcc390e0f087 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lazy-loading 'fault' on Instance uuid 37f3ca38-a4e1-4c99-ace3-be7264f28e4e {{(pid=117885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 22 11:15:23.356656 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-0174c603-beea-48b4-8792-b9144f471a4a tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:23.361356 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-0174c603-beea-48b4-8792-b9144f471a4a tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:23.362265 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-0174c603-beea-48b4-8792-b9144f471a4a tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:23.584448 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-99c9c3c4-7b43-4c75-a51d-fcc390e0f087 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5202e2bdba064c4aaa84e15e1f0f0dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cd35ed100244fdab3228d1afe62400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:15:23.628638 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-0174c603-beea-48b4-8792-b9144f471a4a tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:15:23.633767 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-99c9c3c4-7b43-4c75-a51d-fcc390e0f087 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] 10.222.0.20 "GET /compute/v2.1/servers/37f3ca38-a4e1-4c99-ace3-be7264f28e4e" status: 200 len: 1351 microversion: 2.1 time: 0.346631 Jul 22 11:15:23.650462 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 100/209] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:15:23 2022] GET /compute/v2.1/servers/37f3ca38-a4e1-4c99-ace3-be7264f28e4e => generated 1351 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:15:23.652685 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-0174c603-beea-48b4-8792-b9144f471a4a tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900" status: 200 len: 1522 microversion: 2.1 time: 0.340427 Jul 22 11:15:23.655325 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 110/210] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:15:23 2022] GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900 => generated 1522 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:15:24.687220 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-de35033a-825b-46c8-b6f3-36c87a0e9f42 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:15:24.688804 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-de35033a-825b-46c8-b6f3-36c87a0e9f42 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] [instance: 37f3ca38-a4e1-4c99-ace3-be7264f28e4e] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:15:24.692126 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-6b68e3ff-af1a-45fe-89f8-64237ec227c4 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:15:24.693460 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-6b68e3ff-af1a-45fe-89f8-64237ec227c4 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 3108d9e0-3b2d-402a-aaab-c313c30e7900] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:15:24.700819 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-de35033a-825b-46c8-b6f3-36c87a0e9f42 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:24.701544 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-de35033a-825b-46c8-b6f3-36c87a0e9f42 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:24.702937 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-de35033a-825b-46c8-b6f3-36c87a0e9f42 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:24.703562 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6b68e3ff-af1a-45fe-89f8-64237ec227c4 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:24.703769 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-de35033a-825b-46c8-b6f3-36c87a0e9f42 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:24.704489 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6b68e3ff-af1a-45fe-89f8-64237ec227c4 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:24.705577 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6b68e3ff-af1a-45fe-89f8-64237ec227c4 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:24.706234 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6b68e3ff-af1a-45fe-89f8-64237ec227c4 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:24.733239 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=100 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:15:24.761813 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.wsgi [None req-de35033a-825b-46c8-b6f3-36c87a0e9f42 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] HTTP exception thrown: Instance 37f3ca38-a4e1-4c99-ace3-be7264f28e4e could not be found. Jul 22 11:15:24.765570 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-de35033a-825b-46c8-b6f3-36c87a0e9f42 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Request method failure captured: Jul 22 11:15:24.765570 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: request: GET /compute/v2.1/servers/37f3ca38-a4e1-4c99-ace3-be7264f28e4e HTTP/1.1 Jul 22 11:15:24.765570 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Accept: application/json Jul 22 11:15:24.765570 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Accept-Encoding: identity Jul 22 11:15:24.765570 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Connection: close Jul 22 11:15:24.765570 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Content-Length: 0 Jul 22 11:15:24.765570 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Content-Type: application/json Jul 22 11:15:24.765570 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Host: 10.222.0.20 Jul 22 11:15:24.765570 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Openstack-System-Scope: None Jul 22 11:15:24.765570 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: User-Agent: python-urllib3/1.26.9 Jul 22 11:15:24.765570 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Auth-Token: gAAAAABi2oZ6BoVFRPjIwnopRr7XqtFEmUuxPadf6Q9KG8jw1k04ntYwHU_m-XKjBWBIIobAj-OhrEdVZejIP-5A2d6WoYu0kPRu_4cVQJ6vjEcQxNT7mFKeaqSWowrSij2Oiy5vl3b-t1FtHcY7A3ce-za2fWk_EByUeL-B1beDFdRcSbdL9og Jul 22 11:15:24.765570 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Domain-Id: None Jul 22 11:15:24.765570 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Domain-Name: None Jul 22 11:15:24.765570 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Identity-Status: Confirmed Jul 22 11:15:24.765570 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Is-Admin-Project: True Jul 22 11:15:24.765570 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Domain-Id: default Jul 22 11:15:24.765570 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Domain-Name: Default Jul 22 11:15:24.765570 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Id: 08cd35ed100244fdab3228d1afe62400 Jul 22 11:15:24.765570 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Name: tempest-DeleteServersTestJSON-1361056093 Jul 22 11:15:24.765570 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Role: reader,member Jul 22 11:15:24.765570 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Roles: reader,member Jul 22 11:15:24.768372 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/08cd35ed100244fdab3228d1afe62400"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_08cd35ed100244fdab3228d1afe62400", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/08cd35ed100244fdab3228d1afe62400"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/08cd35ed100244fdab3228d1afe62400"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jul 22 11:15:24.768372 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant: tempest-DeleteServersTestJSON-1361056093 Jul 22 11:15:24.768372 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant-Id: 08cd35ed100244fdab3228d1afe62400 Jul 22 11:15:24.768372 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant-Name: tempest-DeleteServersTestJSON-1361056093 Jul 22 11:15:24.768372 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User: tempest-DeleteServersTestJSON-1361056093-project Jul 22 11:15:24.768372 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Domain-Id: default Jul 22 11:15:24.768372 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Domain-Name: Default Jul 22 11:15:24.768372 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Id: 5202e2bdba064c4aaa84e15e1f0f0dea Jul 22 11:15:24.768372 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Name: tempest-DeleteServersTestJSON-1361056093-project Jul 22 11:15:24.768372 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: method: > Jul 22 11:15:24.768372 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: exception: Instance 37f3ca38-a4e1-4c99-ace3-be7264f28e4e could not be found. Jul 22 11:15:24.768372 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: action_args: {'id': '37f3ca38-a4e1-4c99-ace3-be7264f28e4e'} Jul 22 11:15:24.770021 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 22 11:15:24.770021 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:15:24.770021 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 22 11:15:24.770021 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 22 11:15:24.770021 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 22 11:15:24.770021 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 22 11:15:24.770021 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 22 11:15:24.770021 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 22 11:15:24.770021 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 22 11:15:24.770021 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 22 11:15:24.770021 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37f3ca38-a4e1-4c99-ace3-be7264f28e4e could not be found. Jul 22 11:15:24.770021 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:15:24.770021 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:15:24.770021 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:15:24.770021 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:15:24.770021 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:15:24.770021 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:15:24.770021 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 22 11:15:24.770021 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 22 11:15:24.770021 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 22 11:15:24.772462 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 22 11:15:24.772462 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 22 11:15:24.772462 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 22 11:15:24.772462 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 22 11:15:24.772462 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 22 11:15:24.772462 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 22 11:15:24.772462 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 22 11:15:24.772462 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37f3ca38-a4e1-4c99-ace3-be7264f28e4e could not be found. Jul 22 11:15:24.772462 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:15:24.772462 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:15:24.772462 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:15:24.772462 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:15:24.772462 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:15:24.772462 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:15:24.772462 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 22 11:15:24.772462 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 22 11:15:24.772462 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37f3ca38-a4e1-4c99-ace3-be7264f28e4e could not be found. Jul 22 11:15:24.772462 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:15:24.774567 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-de35033a-825b-46c8-b6f3-36c87a0e9f42 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Returning 404 to user: Instance 37f3ca38-a4e1-4c99-ace3-be7264f28e4e could not be found. {{(pid=117884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 22 11:15:24.775095 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-de35033a-825b-46c8-b6f3-36c87a0e9f42 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] 10.222.0.20 "GET /compute/v2.1/servers/37f3ca38-a4e1-4c99-ace3-be7264f28e4e" status: 404 len: 111 microversion: 2.1 time: 0.100410 Jul 22 11:15:24.776061 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 111/211] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:15:24 2022] GET /compute/v2.1/servers/37f3ca38-a4e1-4c99-ace3-be7264f28e4e => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 22 11:15:24.935080 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-6d4a261c-1f37-402e-bdc8-e71f5f3a2684 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:15:24.937090 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-6d4a261c-1f37-402e-bdc8-e71f5f3a2684 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] [instance: 37f3ca38-a4e1-4c99-ace3-be7264f28e4e] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:15:24.946428 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-6d4a261c-1f37-402e-bdc8-e71f5f3a2684 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:24.947207 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-6d4a261c-1f37-402e-bdc8-e71f5f3a2684 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:24.948779 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-6d4a261c-1f37-402e-bdc8-e71f5f3a2684 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:24.949497 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-6d4a261c-1f37-402e-bdc8-e71f5f3a2684 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:24.969780 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.wsgi [None req-6d4a261c-1f37-402e-bdc8-e71f5f3a2684 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] HTTP exception thrown: Instance 37f3ca38-a4e1-4c99-ace3-be7264f28e4e could not be found. Jul 22 11:15:24.976441 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-6d4a261c-1f37-402e-bdc8-e71f5f3a2684 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Request method failure captured: Jul 22 11:15:24.976441 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: request: GET /compute/v2.1/servers/37f3ca38-a4e1-4c99-ace3-be7264f28e4e/os-volume_attachments HTTP/1.1 Jul 22 11:15:24.976441 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Accept: application/json Jul 22 11:15:24.976441 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Accept-Encoding: identity Jul 22 11:15:24.976441 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Connection: close Jul 22 11:15:24.976441 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Content-Length: 0 Jul 22 11:15:24.976441 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Content-Type: application/json Jul 22 11:15:24.976441 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Host: 10.222.0.20 Jul 22 11:15:24.976441 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Openstack-System-Scope: None Jul 22 11:15:24.976441 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: User-Agent: python-urllib3/1.26.9 Jul 22 11:15:24.976441 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Auth-Token: gAAAAABi2oZ6BoVFRPjIwnopRr7XqtFEmUuxPadf6Q9KG8jw1k04ntYwHU_m-XKjBWBIIobAj-OhrEdVZejIP-5A2d6WoYu0kPRu_4cVQJ6vjEcQxNT7mFKeaqSWowrSij2Oiy5vl3b-t1FtHcY7A3ce-za2fWk_EByUeL-B1beDFdRcSbdL9og Jul 22 11:15:24.976441 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Domain-Id: None Jul 22 11:15:24.976441 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Domain-Name: None Jul 22 11:15:24.976441 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Identity-Status: Confirmed Jul 22 11:15:24.976441 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Is-Admin-Project: True Jul 22 11:15:24.976441 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Domain-Id: default Jul 22 11:15:24.976441 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Domain-Name: Default Jul 22 11:15:24.976441 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Id: 08cd35ed100244fdab3228d1afe62400 Jul 22 11:15:24.976441 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Name: tempest-DeleteServersTestJSON-1361056093 Jul 22 11:15:24.976441 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Role: reader,member Jul 22 11:15:24.976441 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Roles: reader,member Jul 22 11:15:24.978595 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/08cd35ed100244fdab3228d1afe62400"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_08cd35ed100244fdab3228d1afe62400", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/08cd35ed100244fdab3228d1afe62400"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/08cd35ed100244fdab3228d1afe62400"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jul 22 11:15:24.978595 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant: tempest-DeleteServersTestJSON-1361056093 Jul 22 11:15:24.978595 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant-Id: 08cd35ed100244fdab3228d1afe62400 Jul 22 11:15:24.978595 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant-Name: tempest-DeleteServersTestJSON-1361056093 Jul 22 11:15:24.978595 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User: tempest-DeleteServersTestJSON-1361056093-project Jul 22 11:15:24.978595 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Domain-Id: default Jul 22 11:15:24.978595 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Domain-Name: Default Jul 22 11:15:24.978595 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Id: 5202e2bdba064c4aaa84e15e1f0f0dea Jul 22 11:15:24.978595 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Name: tempest-DeleteServersTestJSON-1361056093-project Jul 22 11:15:24.978595 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: method: > Jul 22 11:15:24.978595 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: exception: Instance 37f3ca38-a4e1-4c99-ace3-be7264f28e4e could not be found. Jul 22 11:15:24.978595 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: action_args: {'server_id': '37f3ca38-a4e1-4c99-ace3-be7264f28e4e'} Jul 22 11:15:24.979890 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 22 11:15:24.979890 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:15:24.979890 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 22 11:15:24.979890 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 22 11:15:24.979890 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 22 11:15:24.979890 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 22 11:15:24.979890 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 22 11:15:24.979890 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 22 11:15:24.979890 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 22 11:15:24.979890 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 22 11:15:24.979890 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37f3ca38-a4e1-4c99-ace3-be7264f28e4e could not be found. Jul 22 11:15:24.979890 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:15:24.979890 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:15:24.979890 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:15:24.979890 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:15:24.979890 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:15:24.979890 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:15:24.979890 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 22 11:15:24.979890 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 22 11:15:24.979890 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 22 11:15:24.981954 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 22 11:15:24.981954 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 22 11:15:24.981954 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 22 11:15:24.981954 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 22 11:15:24.981954 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 22 11:15:24.981954 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 22 11:15:24.981954 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 22 11:15:24.981954 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 22 11:15:24.981954 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 22 11:15:24.981954 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37f3ca38-a4e1-4c99-ace3-be7264f28e4e could not be found. Jul 22 11:15:24.981954 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:15:24.981954 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:15:24.981954 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:15:24.981954 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:15:24.981954 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:15:24.981954 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:15:24.981954 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 22 11:15:24.981954 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 22 11:15:24.981954 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37f3ca38-a4e1-4c99-ace3-be7264f28e4e could not be found. Jul 22 11:15:24.981954 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:15:24.983868 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-6d4a261c-1f37-402e-bdc8-e71f5f3a2684 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Returning 404 to user: Instance 37f3ca38-a4e1-4c99-ace3-be7264f28e4e could not be found. {{(pid=117884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 22 11:15:24.983868 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-6d4a261c-1f37-402e-bdc8-e71f5f3a2684 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] 10.222.0.20 "GET /compute/v2.1/servers/37f3ca38-a4e1-4c99-ace3-be7264f28e4e/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.051222 Jul 22 11:15:24.987302 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 112/212] 10.222.0.20 () {58 vars in 1301 bytes} [Fri Jul 22 11:15:24 2022] GET /compute/v2.1/servers/37f3ca38-a4e1-4c99-ace3-be7264f28e4e/os-volume_attachments => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 22 11:15:25.288792 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-6b68e3ff-af1a-45fe-89f8-64237ec227c4 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:15:25.300175 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-6b68e3ff-af1a-45fe-89f8-64237ec227c4 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900" status: 200 len: 1522 microversion: 2.1 time: 0.628580 Jul 22 11:15:25.305591 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 101/213] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:15:24 2022] GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900 => generated 1522 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:15:26.276253 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-48fc00c8-4f0c-4678-a876-fca631412258 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:15:26.277558 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-48fc00c8-4f0c-4678-a876-fca631412258 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] [instance: 37f3ca38-a4e1-4c99-ace3-be7264f28e4e] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:15:26.288934 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-48fc00c8-4f0c-4678-a876-fca631412258 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:26.289625 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-48fc00c8-4f0c-4678-a876-fca631412258 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:26.290566 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-48fc00c8-4f0c-4678-a876-fca631412258 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:26.291141 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-48fc00c8-4f0c-4678-a876-fca631412258 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:26.323119 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.wsgi [None req-48fc00c8-4f0c-4678-a876-fca631412258 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] HTTP exception thrown: Instance 37f3ca38-a4e1-4c99-ace3-be7264f28e4e could not be found. Jul 22 11:15:26.326405 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-48fc00c8-4f0c-4678-a876-fca631412258 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Request method failure captured: Jul 22 11:15:26.326405 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: request: DELETE /compute/v2.1/servers/37f3ca38-a4e1-4c99-ace3-be7264f28e4e HTTP/1.1 Jul 22 11:15:26.326405 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Accept: application/json Jul 22 11:15:26.326405 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Accept-Encoding: identity Jul 22 11:15:26.326405 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Connection: close Jul 22 11:15:26.326405 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Content-Length: 0 Jul 22 11:15:26.326405 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Content-Type: application/json Jul 22 11:15:26.326405 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Host: 10.222.0.20 Jul 22 11:15:26.326405 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Openstack-System-Scope: None Jul 22 11:15:26.326405 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: User-Agent: python-urllib3/1.26.9 Jul 22 11:15:26.326405 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Auth-Token: gAAAAABi2oZ6BoVFRPjIwnopRr7XqtFEmUuxPadf6Q9KG8jw1k04ntYwHU_m-XKjBWBIIobAj-OhrEdVZejIP-5A2d6WoYu0kPRu_4cVQJ6vjEcQxNT7mFKeaqSWowrSij2Oiy5vl3b-t1FtHcY7A3ce-za2fWk_EByUeL-B1beDFdRcSbdL9og Jul 22 11:15:26.326405 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Domain-Id: None Jul 22 11:15:26.326405 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Domain-Name: None Jul 22 11:15:26.326405 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Identity-Status: Confirmed Jul 22 11:15:26.326405 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Is-Admin-Project: True Jul 22 11:15:26.326405 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Domain-Id: default Jul 22 11:15:26.326405 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Domain-Name: Default Jul 22 11:15:26.326405 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Id: 08cd35ed100244fdab3228d1afe62400 Jul 22 11:15:26.326405 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Name: tempest-DeleteServersTestJSON-1361056093 Jul 22 11:15:26.326405 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Role: reader,member Jul 22 11:15:26.326405 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Roles: reader,member Jul 22 11:15:26.328106 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/08cd35ed100244fdab3228d1afe62400"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_08cd35ed100244fdab3228d1afe62400", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/08cd35ed100244fdab3228d1afe62400"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/08cd35ed100244fdab3228d1afe62400"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jul 22 11:15:26.328106 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant: tempest-DeleteServersTestJSON-1361056093 Jul 22 11:15:26.328106 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant-Id: 08cd35ed100244fdab3228d1afe62400 Jul 22 11:15:26.328106 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant-Name: tempest-DeleteServersTestJSON-1361056093 Jul 22 11:15:26.328106 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User: tempest-DeleteServersTestJSON-1361056093-project Jul 22 11:15:26.328106 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Domain-Id: default Jul 22 11:15:26.328106 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Domain-Name: Default Jul 22 11:15:26.328106 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Id: 5202e2bdba064c4aaa84e15e1f0f0dea Jul 22 11:15:26.328106 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Name: tempest-DeleteServersTestJSON-1361056093-project Jul 22 11:15:26.328106 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: method: > Jul 22 11:15:26.328106 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: exception: Instance 37f3ca38-a4e1-4c99-ace3-be7264f28e4e could not be found. Jul 22 11:15:26.328106 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: action_args: {'id': '37f3ca38-a4e1-4c99-ace3-be7264f28e4e'} Jul 22 11:15:26.328902 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 22 11:15:26.328902 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:15:26.328902 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 22 11:15:26.328902 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 22 11:15:26.328902 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 22 11:15:26.328902 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 22 11:15:26.328902 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 22 11:15:26.328902 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 22 11:15:26.328902 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 22 11:15:26.328902 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 22 11:15:26.328902 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37f3ca38-a4e1-4c99-ace3-be7264f28e4e could not be found. Jul 22 11:15:26.328902 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:15:26.328902 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:15:26.328902 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:15:26.328902 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:15:26.328902 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:15:26.328902 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:15:26.328902 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 22 11:15:26.328902 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 22 11:15:26.328902 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 22 11:15:26.330155 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 22 11:15:26.330155 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 22 11:15:26.330155 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 22 11:15:26.330155 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 22 11:15:26.330155 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 22 11:15:26.330155 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 22 11:15:26.330155 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 22 11:15:26.330155 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 22 11:15:26.330155 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 22 11:15:26.330155 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37f3ca38-a4e1-4c99-ace3-be7264f28e4e could not be found. Jul 22 11:15:26.330155 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:15:26.330155 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:15:26.330155 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:15:26.330155 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:15:26.330155 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:15:26.330155 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:15:26.330155 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 22 11:15:26.330155 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 22 11:15:26.330155 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37f3ca38-a4e1-4c99-ace3-be7264f28e4e could not be found. Jul 22 11:15:26.330155 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:15:26.332184 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-52c5c8a7-7e3b-443f-a65c-dc96cd50f650 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:15:26.332184 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-52c5c8a7-7e3b-443f-a65c-dc96cd50f650 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 3108d9e0-3b2d-402a-aaab-c313c30e7900] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:15:26.332816 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-48fc00c8-4f0c-4678-a876-fca631412258 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Returning 404 to user: Instance 37f3ca38-a4e1-4c99-ace3-be7264f28e4e could not be found. {{(pid=117884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 22 11:15:26.333995 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-48fc00c8-4f0c-4678-a876-fca631412258 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] 10.222.0.20 "DELETE /compute/v2.1/servers/37f3ca38-a4e1-4c99-ace3-be7264f28e4e" status: 404 len: 111 microversion: 2.1 time: 0.062649 Jul 22 11:15:26.334917 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 113/214] 10.222.0.20 () {58 vars in 1238 bytes} [Fri Jul 22 11:15:26 2022] DELETE /compute/v2.1/servers/37f3ca38-a4e1-4c99-ace3-be7264f28e4e => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 22 11:15:26.349757 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-9f1ac0d7-b770-4c45-bce2-343edcb454f3 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:15:26.350327 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-9f1ac0d7-b770-4c45-bce2-343edcb454f3 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] [instance: 37f3ca38-a4e1-4c99-ace3-be7264f28e4e] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:15:26.350527 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-52c5c8a7-7e3b-443f-a65c-dc96cd50f650 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:26.351101 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-52c5c8a7-7e3b-443f-a65c-dc96cd50f650 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:26.352105 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-52c5c8a7-7e3b-443f-a65c-dc96cd50f650 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:26.352648 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-52c5c8a7-7e3b-443f-a65c-dc96cd50f650 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:26.360705 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-9f1ac0d7-b770-4c45-bce2-343edcb454f3 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:26.366905 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-9f1ac0d7-b770-4c45-bce2-343edcb454f3 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:26.368427 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-9f1ac0d7-b770-4c45-bce2-343edcb454f3 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:26.369281 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-9f1ac0d7-b770-4c45-bce2-343edcb454f3 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:26.397533 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.wsgi [None req-9f1ac0d7-b770-4c45-bce2-343edcb454f3 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] HTTP exception thrown: Instance 37f3ca38-a4e1-4c99-ace3-be7264f28e4e could not be found. Jul 22 11:15:26.399839 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-9f1ac0d7-b770-4c45-bce2-343edcb454f3 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Request method failure captured: Jul 22 11:15:26.399839 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: request: GET /compute/v2.1/servers/37f3ca38-a4e1-4c99-ace3-be7264f28e4e HTTP/1.1 Jul 22 11:15:26.399839 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Accept: application/json Jul 22 11:15:26.399839 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Accept-Encoding: identity Jul 22 11:15:26.399839 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Connection: close Jul 22 11:15:26.399839 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Content-Length: 0 Jul 22 11:15:26.399839 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Content-Type: application/json Jul 22 11:15:26.399839 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Host: 10.222.0.20 Jul 22 11:15:26.399839 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Openstack-System-Scope: None Jul 22 11:15:26.399839 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: User-Agent: python-urllib3/1.26.9 Jul 22 11:15:26.399839 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Auth-Token: gAAAAABi2oZ6BoVFRPjIwnopRr7XqtFEmUuxPadf6Q9KG8jw1k04ntYwHU_m-XKjBWBIIobAj-OhrEdVZejIP-5A2d6WoYu0kPRu_4cVQJ6vjEcQxNT7mFKeaqSWowrSij2Oiy5vl3b-t1FtHcY7A3ce-za2fWk_EByUeL-B1beDFdRcSbdL9og Jul 22 11:15:26.399839 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Domain-Id: None Jul 22 11:15:26.399839 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Domain-Name: None Jul 22 11:15:26.399839 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Identity-Status: Confirmed Jul 22 11:15:26.399839 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Is-Admin-Project: True Jul 22 11:15:26.399839 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Domain-Id: default Jul 22 11:15:26.399839 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Domain-Name: Default Jul 22 11:15:26.399839 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Id: 08cd35ed100244fdab3228d1afe62400 Jul 22 11:15:26.399839 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Name: tempest-DeleteServersTestJSON-1361056093 Jul 22 11:15:26.399839 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Role: reader,member Jul 22 11:15:26.399839 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Roles: reader,member Jul 22 11:15:26.402347 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/08cd35ed100244fdab3228d1afe62400"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_08cd35ed100244fdab3228d1afe62400", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/08cd35ed100244fdab3228d1afe62400"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/08cd35ed100244fdab3228d1afe62400"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jul 22 11:15:26.402347 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant: tempest-DeleteServersTestJSON-1361056093 Jul 22 11:15:26.402347 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant-Id: 08cd35ed100244fdab3228d1afe62400 Jul 22 11:15:26.402347 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant-Name: tempest-DeleteServersTestJSON-1361056093 Jul 22 11:15:26.402347 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User: tempest-DeleteServersTestJSON-1361056093-project Jul 22 11:15:26.402347 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Domain-Id: default Jul 22 11:15:26.402347 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Domain-Name: Default Jul 22 11:15:26.402347 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Id: 5202e2bdba064c4aaa84e15e1f0f0dea Jul 22 11:15:26.402347 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Name: tempest-DeleteServersTestJSON-1361056093-project Jul 22 11:15:26.402347 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: method: > Jul 22 11:15:26.402347 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: exception: Instance 37f3ca38-a4e1-4c99-ace3-be7264f28e4e could not be found. Jul 22 11:15:26.402347 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: action_args: {'id': '37f3ca38-a4e1-4c99-ace3-be7264f28e4e'} Jul 22 11:15:26.403780 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 22 11:15:26.403780 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:15:26.403780 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 22 11:15:26.403780 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 22 11:15:26.403780 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 22 11:15:26.403780 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 22 11:15:26.403780 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 22 11:15:26.403780 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 22 11:15:26.403780 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 22 11:15:26.403780 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 22 11:15:26.403780 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37f3ca38-a4e1-4c99-ace3-be7264f28e4e could not be found. Jul 22 11:15:26.403780 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:15:26.403780 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:15:26.403780 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:15:26.403780 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:15:26.403780 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:15:26.403780 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:15:26.403780 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 22 11:15:26.403780 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 22 11:15:26.403780 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 22 11:15:26.405618 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 22 11:15:26.405618 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 22 11:15:26.405618 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 22 11:15:26.405618 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 22 11:15:26.405618 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 22 11:15:26.405618 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 22 11:15:26.405618 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 22 11:15:26.405618 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37f3ca38-a4e1-4c99-ace3-be7264f28e4e could not be found. Jul 22 11:15:26.405618 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:15:26.405618 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:15:26.405618 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:15:26.405618 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:15:26.405618 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:15:26.405618 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:15:26.405618 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 22 11:15:26.405618 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 22 11:15:26.405618 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37f3ca38-a4e1-4c99-ace3-be7264f28e4e could not be found. Jul 22 11:15:26.405618 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:15:26.411905 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-9f1ac0d7-b770-4c45-bce2-343edcb454f3 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] Returning 404 to user: Instance 37f3ca38-a4e1-4c99-ace3-be7264f28e4e could not be found. {{(pid=117884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 22 11:15:26.411905 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-9f1ac0d7-b770-4c45-bce2-343edcb454f3 tempest-DeleteServersTestJSON-1361056093 tempest-DeleteServersTestJSON-1361056093-project] 10.222.0.20 "GET /compute/v2.1/servers/37f3ca38-a4e1-4c99-ace3-be7264f28e4e" status: 404 len: 111 microversion: 2.1 time: 0.062827 Jul 22 11:15:26.411905 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 114/215] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:15:26 2022] GET /compute/v2.1/servers/37f3ca38-a4e1-4c99-ace3-be7264f28e4e => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 22 11:15:26.781968 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-52c5c8a7-7e3b-443f-a65c-dc96cd50f650 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:15:26.799642 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-52c5c8a7-7e3b-443f-a65c-dc96cd50f650 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900" status: 200 len: 1522 microversion: 2.1 time: 0.477524 Jul 22 11:15:26.811643 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 102/216] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:15:26 2022] GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900 => generated 1522 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:15:27.837770 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-3e8ea34e-32be-4919-a6c3-9a838378e7a0 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:15:27.842369 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-3e8ea34e-32be-4919-a6c3-9a838378e7a0 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 3108d9e0-3b2d-402a-aaab-c313c30e7900] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:15:27.890326 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG dbcounter [-] [117884] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=117884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:15:27.899048 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-3e8ea34e-32be-4919-a6c3-9a838378e7a0 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:27.899881 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-3e8ea34e-32be-4919-a6c3-9a838378e7a0 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:27.900816 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-3e8ea34e-32be-4919-a6c3-9a838378e7a0 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:27.905859 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-3e8ea34e-32be-4919-a6c3-9a838378e7a0 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:28.334139 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-3e8ea34e-32be-4919-a6c3-9a838378e7a0 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:15:28.356866 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-3e8ea34e-32be-4919-a6c3-9a838378e7a0 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900" status: 200 len: 1522 microversion: 2.1 time: 0.530354 Jul 22 11:15:28.367688 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 115/217] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:15:27 2022] GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900 => generated 1522 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:15:29.381494 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-67131c62-7183-4a4e-b24f-4d6b4a313b2d tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:15:29.382218 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-67131c62-7183-4a4e-b24f-4d6b4a313b2d tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 3108d9e0-3b2d-402a-aaab-c313c30e7900] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:15:29.405071 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-67131c62-7183-4a4e-b24f-4d6b4a313b2d tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:29.405988 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-67131c62-7183-4a4e-b24f-4d6b4a313b2d tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:29.408052 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-67131c62-7183-4a4e-b24f-4d6b4a313b2d tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:29.410652 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-67131c62-7183-4a4e-b24f-4d6b4a313b2d tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:29.817155 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-67131c62-7183-4a4e-b24f-4d6b4a313b2d tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:15:29.829987 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-67131c62-7183-4a4e-b24f-4d6b4a313b2d tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900" status: 200 len: 1522 microversion: 2.1 time: 0.458181 Jul 22 11:15:29.846353 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 103/218] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:15:29 2022] GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900 => generated 1522 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:15:30.870080 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-3edfb01b-1d89-4297-9b3a-f5d5d6e8df10 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:15:30.872713 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-3edfb01b-1d89-4297-9b3a-f5d5d6e8df10 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 3108d9e0-3b2d-402a-aaab-c313c30e7900] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:15:30.890557 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-3edfb01b-1d89-4297-9b3a-f5d5d6e8df10 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:30.892289 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-3edfb01b-1d89-4297-9b3a-f5d5d6e8df10 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:30.895014 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-3edfb01b-1d89-4297-9b3a-f5d5d6e8df10 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:30.896076 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-3edfb01b-1d89-4297-9b3a-f5d5d6e8df10 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:31.517831 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-3edfb01b-1d89-4297-9b3a-f5d5d6e8df10 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:15:31.531559 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-3edfb01b-1d89-4297-9b3a-f5d5d6e8df10 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900" status: 200 len: 1522 microversion: 2.1 time: 0.669209 Jul 22 11:15:31.533836 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 116/219] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:15:30 2022] GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900 => generated 1522 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:15:32.557161 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-0caf50af-4e84-4ef5-b8e7-0b3e7d25d592 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:15:32.557771 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-0caf50af-4e84-4ef5-b8e7-0b3e7d25d592 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 3108d9e0-3b2d-402a-aaab-c313c30e7900] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:15:32.573528 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0caf50af-4e84-4ef5-b8e7-0b3e7d25d592 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:32.584875 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0caf50af-4e84-4ef5-b8e7-0b3e7d25d592 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:32.586469 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0caf50af-4e84-4ef5-b8e7-0b3e7d25d592 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:32.587250 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0caf50af-4e84-4ef5-b8e7-0b3e7d25d592 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:33.753461 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-0caf50af-4e84-4ef5-b8e7-0b3e7d25d592 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:15:33.762464 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-0caf50af-4e84-4ef5-b8e7-0b3e7d25d592 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900" status: 200 len: 1522 microversion: 2.1 time: 1.210808 Jul 22 11:15:33.765103 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 104/220] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:15:32 2022] GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900 => generated 1522 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:15:34.790712 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-81edd7fa-6580-448b-a3bf-f92f396cff61 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:15:34.791909 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-81edd7fa-6580-448b-a3bf-f92f396cff61 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 3108d9e0-3b2d-402a-aaab-c313c30e7900] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:15:34.807251 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-81edd7fa-6580-448b-a3bf-f92f396cff61 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:34.811366 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-81edd7fa-6580-448b-a3bf-f92f396cff61 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:34.812718 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-81edd7fa-6580-448b-a3bf-f92f396cff61 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:34.814554 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-81edd7fa-6580-448b-a3bf-f92f396cff61 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:35.127053 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-81edd7fa-6580-448b-a3bf-f92f396cff61 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:15:35.153685 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-81edd7fa-6580-448b-a3bf-f92f396cff61 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900" status: 200 len: 1522 microversion: 2.1 time: 0.377634 Jul 22 11:15:35.155310 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 117/221] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:15:34 2022] GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900 => generated 1522 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:15:36.177736 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-ee818bc8-a316-412d-a96a-0884c6ad8a7c tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:15:36.179870 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-ee818bc8-a316-412d-a96a-0884c6ad8a7c tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 3108d9e0-3b2d-402a-aaab-c313c30e7900] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:15:36.188281 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ee818bc8-a316-412d-a96a-0884c6ad8a7c tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:36.190386 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ee818bc8-a316-412d-a96a-0884c6ad8a7c tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:36.195506 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ee818bc8-a316-412d-a96a-0884c6ad8a7c tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:36.197154 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ee818bc8-a316-412d-a96a-0884c6ad8a7c tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:36.752103 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-ee818bc8-a316-412d-a96a-0884c6ad8a7c tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:15:36.766790 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-ee818bc8-a316-412d-a96a-0884c6ad8a7c tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900" status: 200 len: 1522 microversion: 2.1 time: 0.590879 Jul 22 11:15:36.769656 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 105/222] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:15:36 2022] GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900 => generated 1522 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:15:37.791013 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-a0511851-3a78-4ed3-9322-bc1d981f2eb5 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:15:37.792294 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-a0511851-3a78-4ed3-9322-bc1d981f2eb5 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 3108d9e0-3b2d-402a-aaab-c313c30e7900] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:15:37.814573 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-a0511851-3a78-4ed3-9322-bc1d981f2eb5 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:37.814573 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-a0511851-3a78-4ed3-9322-bc1d981f2eb5 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:37.814573 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-a0511851-3a78-4ed3-9322-bc1d981f2eb5 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:37.814573 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-a0511851-3a78-4ed3-9322-bc1d981f2eb5 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:38.244708 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-a0511851-3a78-4ed3-9322-bc1d981f2eb5 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:15:38.268602 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-a0511851-3a78-4ed3-9322-bc1d981f2eb5 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900" status: 200 len: 1522 microversion: 2.1 time: 0.482065 Jul 22 11:15:38.279553 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 118/223] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:15:37 2022] GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900 => generated 1522 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:15:39.302208 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-5aad2749-db3c-4064-9fea-dd745ce5d039 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:15:39.316020 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-5aad2749-db3c-4064-9fea-dd745ce5d039 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 3108d9e0-3b2d-402a-aaab-c313c30e7900] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:15:39.361045 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5aad2749-db3c-4064-9fea-dd745ce5d039 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:39.361514 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5aad2749-db3c-4064-9fea-dd745ce5d039 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:39.372749 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5aad2749-db3c-4064-9fea-dd745ce5d039 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:39.373215 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5aad2749-db3c-4064-9fea-dd745ce5d039 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:39.728119 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-5aad2749-db3c-4064-9fea-dd745ce5d039 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:15:39.750685 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-5aad2749-db3c-4064-9fea-dd745ce5d039 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900" status: 200 len: 1522 microversion: 2.1 time: 0.455514 Jul 22 11:15:39.751545 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 106/224] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:15:39 2022] GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900 => generated 1522 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:15:40.778080 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-cdab0cca-671b-4d29-885c-72a85e83eda3 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:15:40.779027 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-cdab0cca-671b-4d29-885c-72a85e83eda3 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 3108d9e0-3b2d-402a-aaab-c313c30e7900] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:15:40.825147 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-cdab0cca-671b-4d29-885c-72a85e83eda3 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:40.832971 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-cdab0cca-671b-4d29-885c-72a85e83eda3 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:40.835117 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-cdab0cca-671b-4d29-885c-72a85e83eda3 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:40.843558 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-cdab0cca-671b-4d29-885c-72a85e83eda3 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:41.578505 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-cdab0cca-671b-4d29-885c-72a85e83eda3 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:15:41.617098 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-cdab0cca-671b-4d29-885c-72a85e83eda3 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900" status: 200 len: 1522 microversion: 2.1 time: 0.832765 Jul 22 11:15:41.635424 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 119/225] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:15:40 2022] GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900 => generated 1522 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:15:42.643547 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-11bde116-fded-48e8-a40f-cc1acae28a43 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:15:42.644366 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-11bde116-fded-48e8-a40f-cc1acae28a43 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 3108d9e0-3b2d-402a-aaab-c313c30e7900] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:15:42.652064 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-11bde116-fded-48e8-a40f-cc1acae28a43 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:42.652568 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-11bde116-fded-48e8-a40f-cc1acae28a43 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:42.653599 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-11bde116-fded-48e8-a40f-cc1acae28a43 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:42.654050 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-11bde116-fded-48e8-a40f-cc1acae28a43 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:42.885597 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-11bde116-fded-48e8-a40f-cc1acae28a43 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:15:42.908138 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-11bde116-fded-48e8-a40f-cc1acae28a43 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900" status: 200 len: 1522 microversion: 2.1 time: 0.269334 Jul 22 11:15:42.911319 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 107/226] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:15:42 2022] GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900 => generated 1522 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:15:43.933035 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-72e96e29-5a11-4e70-8ce8-81977baff357 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:15:43.941379 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-72e96e29-5a11-4e70-8ce8-81977baff357 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 3108d9e0-3b2d-402a-aaab-c313c30e7900] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:15:43.983503 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-72e96e29-5a11-4e70-8ce8-81977baff357 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:43.984764 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-72e96e29-5a11-4e70-8ce8-81977baff357 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:43.988801 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-72e96e29-5a11-4e70-8ce8-81977baff357 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:43.993414 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-72e96e29-5a11-4e70-8ce8-81977baff357 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:44.332718 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-72e96e29-5a11-4e70-8ce8-81977baff357 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:15:44.351567 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-72e96e29-5a11-4e70-8ce8-81977baff357 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900" status: 200 len: 1522 microversion: 2.1 time: 0.427342 Jul 22 11:15:44.366204 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 120/227] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:15:43 2022] GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900 => generated 1522 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:15:45.385454 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-dd00aa98-a0e4-468a-bdf8-9e12a9de1409 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:15:45.386489 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-dd00aa98-a0e4-468a-bdf8-9e12a9de1409 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 3108d9e0-3b2d-402a-aaab-c313c30e7900] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:15:45.415003 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dd00aa98-a0e4-468a-bdf8-9e12a9de1409 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:45.415872 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dd00aa98-a0e4-468a-bdf8-9e12a9de1409 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:45.418611 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dd00aa98-a0e4-468a-bdf8-9e12a9de1409 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:45.419345 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dd00aa98-a0e4-468a-bdf8-9e12a9de1409 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:46.076049 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-dd00aa98-a0e4-468a-bdf8-9e12a9de1409 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:15:46.120062 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-dd00aa98-a0e4-468a-bdf8-9e12a9de1409 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900" status: 200 len: 1522 microversion: 2.1 time: 0.743412 Jul 22 11:15:46.133569 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 108/228] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:15:45 2022] GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900 => generated 1522 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:15:47.143205 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-ec6327a2-4a39-41c6-a86f-aa6e8cb1eae6 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:15:47.144240 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-ec6327a2-4a39-41c6-a86f-aa6e8cb1eae6 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 3108d9e0-3b2d-402a-aaab-c313c30e7900] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:15:47.168801 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-ec6327a2-4a39-41c6-a86f-aa6e8cb1eae6 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:47.169505 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-ec6327a2-4a39-41c6-a86f-aa6e8cb1eae6 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:47.170459 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-ec6327a2-4a39-41c6-a86f-aa6e8cb1eae6 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:47.171521 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-ec6327a2-4a39-41c6-a86f-aa6e8cb1eae6 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:48.295197 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-ec6327a2-4a39-41c6-a86f-aa6e8cb1eae6 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:15:48.313943 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-ec6327a2-4a39-41c6-a86f-aa6e8cb1eae6 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900" status: 200 len: 1522 microversion: 2.1 time: 1.176921 Jul 22 11:15:48.314635 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 121/229] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:15:47 2022] GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900 => generated 1522 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:15:49.343081 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-1f7d4103-3e33-4f60-8c43-9f248b31b3db tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:15:49.356290 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-1f7d4103-3e33-4f60-8c43-9f248b31b3db tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 3108d9e0-3b2d-402a-aaab-c313c30e7900] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:15:49.408721 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-1f7d4103-3e33-4f60-8c43-9f248b31b3db tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:49.410307 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-1f7d4103-3e33-4f60-8c43-9f248b31b3db tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:49.412505 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-1f7d4103-3e33-4f60-8c43-9f248b31b3db tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:49.414987 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-1f7d4103-3e33-4f60-8c43-9f248b31b3db tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:49.451970 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-f4b4be42-ca5c-4881-b25a-ed03a111558d tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Action: 'create', calling method: .version_select at 0x7f8445607280>, body: {"keypair": {"name": "tempest-keypair-1959724869", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFX2Ie1p+00RUdGbKrEQBPnTqzYCYzpKbbiJrd9eL/de72B+ANGxDsNHmKthX/Rw7hUKodw5uDoXMXPlzoVaDcHlL3AnDEhnL4x1Yc1O+M1YluJ15QblbZyGIdkEf7KukA=="}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:15:49.583253 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-f4b4be42-ca5c-4881-b25a-ed03a111558d tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Getting quotas for project b745569c01e04aa18f5494b0856bc3d1. Resources: {'key_pairs'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 22 11:15:49.621773 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-f4b4be42-ca5c-4881-b25a-ed03a111558d tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Getting quotas for user 99798aca08904bc787f5d0afee8d0ac7 and project b745569c01e04aa18f5494b0856bc3d1. Resources: {'key_pairs'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 22 11:15:49.684225 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-f4b4be42-ca5c-4881-b25a-ed03a111558d tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.548765 Jul 22 11:15:49.693201 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 109/230] 10.222.0.20 () {62 vars in 1199 bytes} [Fri Jul 22 11:15:49 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 559 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 22 11:15:49.996626 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-1f7d4103-3e33-4f60-8c43-9f248b31b3db tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:15:50.037500 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-1f7d4103-3e33-4f60-8c43-9f248b31b3db tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900" status: 200 len: 1522 microversion: 2.1 time: 0.706428 Jul 22 11:15:50.041154 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 122/231] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:15:49 2022] GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900 => generated 1522 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:15:51.072626 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-d645534a-5a27-41d9-a251-0d6567428e32 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:15:51.074558 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-d645534a-5a27-41d9-a251-0d6567428e32 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 3108d9e0-3b2d-402a-aaab-c313c30e7900] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:15:51.089767 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:15:51.110829 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d645534a-5a27-41d9-a251-0d6567428e32 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:51.111941 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d645534a-5a27-41d9-a251-0d6567428e32 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:51.113718 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d645534a-5a27-41d9-a251-0d6567428e32 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:51.115929 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d645534a-5a27-41d9-a251-0d6567428e32 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:51.930337 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-d645534a-5a27-41d9-a251-0d6567428e32 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:15:51.943495 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-d645534a-5a27-41d9-a251-0d6567428e32 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900" status: 200 len: 1502 microversion: 2.1 time: 0.887309 Jul 22 11:15:51.944180 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 110/232] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:15:51 2022] GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900 => generated 1502 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:15:52.016483 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-a04bc0a4-1a05-4fd2-9930-b8f2feb6e205 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:15:52.017892 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-a04bc0a4-1a05-4fd2-9930-b8f2feb6e205 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: fbf8cb41-3496-45fe-9392-6add8f6873d0] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:15:52.025417 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-a04bc0a4-1a05-4fd2-9930-b8f2feb6e205 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:52.026426 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-a04bc0a4-1a05-4fd2-9930-b8f2feb6e205 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:52.027463 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-a04bc0a4-1a05-4fd2-9930-b8f2feb6e205 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:52.028245 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-a04bc0a4-1a05-4fd2-9930-b8f2feb6e205 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:52.366612 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-a04bc0a4-1a05-4fd2-9930-b8f2feb6e205 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:15:52.369334 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG dbcounter [-] [117884] Writing DB stats nova_cell1:SELECT=73 {{(pid=117884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:15:52.397216 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-a04bc0a4-1a05-4fd2-9930-b8f2feb6e205 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0" status: 200 len: 1516 microversion: 2.1 time: 0.433470 Jul 22 11:15:52.399764 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 123/233] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:15:51 2022] GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0 => generated 1516 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:15:54.155961 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-64995b2f-e47d-4d90-aa0f-ad589e108d01 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1252367782", "imageRef": "1a6c3cb4-9f56-44c6-aa68-01000df27209", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7318ffdd-ae63-4738-8d01-53fbef338615"}], "security_groups": [{"name": "tempest-securitygroup--1174367299"}], "key_name": "tempest-keypair-1959724869", "user_data": "}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:15:54.457282 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.network.neutron [None req-64995b2f-e47d-4d90-aa0f-ad589e108d01 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] validate_networks() for [('7318ffdd-ae63-4738-8d01-53fbef338615', None, None, None, None, None)] {{(pid=117885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 22 11:15:54.470114 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-dd252655-bf3c-46cd-b962-97dcf745ae44 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:15:54.472235 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-dd252655-bf3c-46cd-b962-97dcf745ae44 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: fbf8cb41-3496-45fe-9392-6add8f6873d0] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:15:54.479644 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-dd252655-bf3c-46cd-b962-97dcf745ae44 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:54.481948 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-dd252655-bf3c-46cd-b962-97dcf745ae44 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:54.484752 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-dd252655-bf3c-46cd-b962-97dcf745ae44 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:54.485425 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-dd252655-bf3c-46cd-b962-97dcf745ae44 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:54.538222 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.objects.instance [None req-dd252655-bf3c-46cd-b962-97dcf745ae44 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lazy-loading 'flavor' on Instance uuid fbf8cb41-3496-45fe-9392-6add8f6873d0 {{(pid=117884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 22 11:15:54.815889 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-dd252655-bf3c-46cd-b962-97dcf745ae44 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "POST /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0/action" status: 200 len: 32 microversion: 2.1 time: 0.350557 Jul 22 11:15:54.817000 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 124/234] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Jul 22 11:15:54 2022] POST /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0/action => generated 32 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 22 11:15:54.830193 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-8f1b92a7-e76f-414e-9c4f-826d3d60369e tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:15:54.831228 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-8f1b92a7-e76f-414e-9c4f-826d3d60369e tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: fbf8cb41-3496-45fe-9392-6add8f6873d0] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:15:54.864440 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-8f1b92a7-e76f-414e-9c4f-826d3d60369e tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:54.874888 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-8f1b92a7-e76f-414e-9c4f-826d3d60369e tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:54.879083 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-8f1b92a7-e76f-414e-9c4f-826d3d60369e tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:54.879603 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-8f1b92a7-e76f-414e-9c4f-826d3d60369e tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:55.283363 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-8f1b92a7-e76f-414e-9c4f-826d3d60369e tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:15:55.302759 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-8f1b92a7-e76f-414e-9c4f-826d3d60369e tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0" status: 200 len: 1522 microversion: 2.1 time: 0.478346 Jul 22 11:15:55.304318 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 125/235] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:15:54 2022] GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0 => generated 1522 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:15:56.329512 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-ad186228-566b-4876-8fa1-6a907c75c72f tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:15:56.330690 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-ad186228-566b-4876-8fa1-6a907c75c72f tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: fbf8cb41-3496-45fe-9392-6add8f6873d0] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:15:56.387860 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-64995b2f-e47d-4d90-aa0f-ad589e108d01 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Flavor limits 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 22 11:15:56.388318 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-64995b2f-e47d-4d90-aa0f-ad589e108d01 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Image limits 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 22 11:15:56.388846 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-64995b2f-e47d-4d90-aa0f-ad589e108d01 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Flavor pref 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 22 11:15:56.389815 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-64995b2f-e47d-4d90-aa0f-ad589e108d01 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Image pref 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 22 11:15:56.390880 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-64995b2f-e47d-4d90-aa0f-ad589e108d01 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 22 11:15:56.395432 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-ad186228-566b-4876-8fa1-6a907c75c72f tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:56.396176 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-ad186228-566b-4876-8fa1-6a907c75c72f tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:56.397330 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-ad186228-566b-4876-8fa1-6a907c75c72f tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:56.398540 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-ad186228-566b-4876-8fa1-6a907c75c72f tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:56.430338 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-64995b2f-e47d-4d90-aa0f-ad589e108d01 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:56.431100 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-64995b2f-e47d-4d90-aa0f-ad589e108d01 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:56.432198 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-64995b2f-e47d-4d90-aa0f-ad589e108d01 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:56.432945 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-64995b2f-e47d-4d90-aa0f-ad589e108d01 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:56.481855 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=53 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:15:56.567354 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-64995b2f-e47d-4d90-aa0f-ad589e108d01 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Getting quotas for project b745569c01e04aa18f5494b0856bc3d1. Resources: {'instances', 'cores', 'ram'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 22 11:15:56.595859 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-64995b2f-e47d-4d90-aa0f-ad589e108d01 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Getting quotas for user 99798aca08904bc787f5d0afee8d0ac7 and project b745569c01e04aa18f5494b0856bc3d1. Resources: {'instances', 'cores', 'ram'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 22 11:15:56.672312 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-64995b2f-e47d-4d90-aa0f-ad589e108d01 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Going to run 1 instances... {{(pid=117885) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 22 11:15:56.681963 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-64995b2f-e47d-4d90-aa0f-ad589e108d01 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1a6c3cb4-9f56-44c6-aa68-01000df27209',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 22 11:15:56.911327 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-64995b2f-e47d-4d90-aa0f-ad589e108d01 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.763239 Jul 22 11:15:56.915733 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 111/236] 10.222.0.20 () {62 vars in 1187 bytes} [Fri Jul 22 11:15:54 2022] POST /compute/v2.1/servers => generated 402 bytes in 2769 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 22 11:15:56.935591 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-d5ce36a3-cb0c-496c-a39f-66e377938bd7 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:15:56.947688 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-d5ce36a3-cb0c-496c-a39f-66e377938bd7 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:15:57.191701 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-ad186228-566b-4876-8fa1-6a907c75c72f tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:15:57.209094 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-ad186228-566b-4876-8fa1-6a907c75c72f tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0" status: 200 len: 1522 microversion: 2.1 time: 0.889616 Jul 22 11:15:57.212739 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 126/237] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:15:56 2022] GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0 => generated 1522 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:15:57.370670 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-d5ce36a3-cb0c-496c-a39f-66e377938bd7 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:15:57.382896 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-d5ce36a3-cb0c-496c-a39f-66e377938bd7 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:15:57.392091 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-d5ce36a3-cb0c-496c-a39f-66e377938bd7 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:15:57.394279 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-d5ce36a3-cb0c-496c-a39f-66e377938bd7 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54" status: 200 len: 1282 microversion: 2.20 time: 0.468437 Jul 22 11:15:57.397041 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 112/238] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:15:56 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 => generated 1282 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:15:58.242525 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-a345a309-a67e-4370-8f40-ad601ef5dad9 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:15:58.244798 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-a345a309-a67e-4370-8f40-ad601ef5dad9 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: fbf8cb41-3496-45fe-9392-6add8f6873d0] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:15:58.250791 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG dbcounter [-] [117884] Writing DB stats nova_api:SELECT=24 {{(pid=117884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:15:58.276111 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-a345a309-a67e-4370-8f40-ad601ef5dad9 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:58.287306 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-a345a309-a67e-4370-8f40-ad601ef5dad9 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:58.293083 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-a345a309-a67e-4370-8f40-ad601ef5dad9 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:58.295191 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-a345a309-a67e-4370-8f40-ad601ef5dad9 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:58.419577 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-8d277dc6-0888-4268-8084-365f97254798 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:15:58.421147 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-8d277dc6-0888-4268-8084-365f97254798 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:15:58.467872 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8d277dc6-0888-4268-8084-365f97254798 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:58.472009 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8d277dc6-0888-4268-8084-365f97254798 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:58.473643 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8d277dc6-0888-4268-8084-365f97254798 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:58.476460 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8d277dc6-0888-4268-8084-365f97254798 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:58.704181 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-8d277dc6-0888-4268-8084-365f97254798 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:15:58.742582 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-8d277dc6-0888-4268-8084-365f97254798 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:15:58.745756 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-8d277dc6-0888-4268-8084-365f97254798 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:15:58.748035 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-8d277dc6-0888-4268-8084-365f97254798 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54" status: 200 len: 1278 microversion: 2.20 time: 0.334958 Jul 22 11:15:58.749120 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 113/239] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:15:58 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 => generated 1278 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:15:58.795866 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-a345a309-a67e-4370-8f40-ad601ef5dad9 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:15:58.815001 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-a345a309-a67e-4370-8f40-ad601ef5dad9 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0" status: 200 len: 1522 microversion: 2.1 time: 0.576605 Jul 22 11:15:58.820896 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 127/240] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:15:58 2022] GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0 => generated 1522 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:15:59.767415 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-f55fc783-75d9-4bde-abaf-a04956164984 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:15:59.768265 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-f55fc783-75d9-4bde-abaf-a04956164984 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:15:59.776026 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f55fc783-75d9-4bde-abaf-a04956164984 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:59.778752 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f55fc783-75d9-4bde-abaf-a04956164984 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:59.788144 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f55fc783-75d9-4bde-abaf-a04956164984 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:59.788725 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f55fc783-75d9-4bde-abaf-a04956164984 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:59.843132 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-da0e2991-b9ee-46f6-b662-aa012bb935c7 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:15:59.844318 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-da0e2991-b9ee-46f6-b662-aa012bb935c7 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: fbf8cb41-3496-45fe-9392-6add8f6873d0] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:15:59.911191 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-da0e2991-b9ee-46f6-b662-aa012bb935c7 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:59.914850 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-da0e2991-b9ee-46f6-b662-aa012bb935c7 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:15:59.919922 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-da0e2991-b9ee-46f6-b662-aa012bb935c7 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:15:59.921593 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-da0e2991-b9ee-46f6-b662-aa012bb935c7 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:00.014343 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-f55fc783-75d9-4bde-abaf-a04956164984 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:00.030195 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-f55fc783-75d9-4bde-abaf-a04956164984 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:00.033715 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-f55fc783-75d9-4bde-abaf-a04956164984 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:00.039702 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-f55fc783-75d9-4bde-abaf-a04956164984 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54" status: 200 len: 1342 microversion: 2.20 time: 0.272515 Jul 22 11:16:00.052202 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 114/241] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:15:59 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 => generated 1342 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:16:00.427423 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-da0e2991-b9ee-46f6-b662-aa012bb935c7 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:00.443968 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-da0e2991-b9ee-46f6-b662-aa012bb935c7 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0" status: 200 len: 1522 microversion: 2.1 time: 0.609231 Jul 22 11:16:00.444676 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 128/242] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:15:59 2022] GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0 => generated 1522 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:16:01.058142 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-9aa7fb94-0a3b-47ce-8d8c-8a692c97ac3e tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:01.060534 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-9aa7fb94-0a3b-47ce-8d8c-8a692c97ac3e tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:01.070892 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9aa7fb94-0a3b-47ce-8d8c-8a692c97ac3e tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:01.072920 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9aa7fb94-0a3b-47ce-8d8c-8a692c97ac3e tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:01.076257 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9aa7fb94-0a3b-47ce-8d8c-8a692c97ac3e tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:01.080916 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9aa7fb94-0a3b-47ce-8d8c-8a692c97ac3e tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:01.193783 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-9aa7fb94-0a3b-47ce-8d8c-8a692c97ac3e tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:01.203625 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-9aa7fb94-0a3b-47ce-8d8c-8a692c97ac3e tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:01.205348 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-9aa7fb94-0a3b-47ce-8d8c-8a692c97ac3e tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:01.206665 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-9aa7fb94-0a3b-47ce-8d8c-8a692c97ac3e tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54" status: 200 len: 1340 microversion: 2.20 time: 0.152505 Jul 22 11:16:01.207672 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 115/243] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:16:01 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 => generated 1340 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:16:01.471554 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-6af50d67-b472-46b7-ac2e-140e0cd56847 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:01.472561 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-6af50d67-b472-46b7-ac2e-140e0cd56847 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: fbf8cb41-3496-45fe-9392-6add8f6873d0] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:01.532263 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-6af50d67-b472-46b7-ac2e-140e0cd56847 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:01.543146 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-6af50d67-b472-46b7-ac2e-140e0cd56847 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:01.550061 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-6af50d67-b472-46b7-ac2e-140e0cd56847 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:01.551066 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-6af50d67-b472-46b7-ac2e-140e0cd56847 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:01.995218 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-6af50d67-b472-46b7-ac2e-140e0cd56847 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:02.009956 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-6af50d67-b472-46b7-ac2e-140e0cd56847 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0" status: 200 len: 1522 microversion: 2.1 time: 0.547332 Jul 22 11:16:02.029516 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 129/244] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:01 2022] GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0 => generated 1522 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:16:02.224520 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-d209f642-30a3-450d-a6ed-ad5ed4a50e62 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:02.225216 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-d209f642-30a3-450d-a6ed-ad5ed4a50e62 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:02.235398 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d209f642-30a3-450d-a6ed-ad5ed4a50e62 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:02.240377 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d209f642-30a3-450d-a6ed-ad5ed4a50e62 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:02.245014 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d209f642-30a3-450d-a6ed-ad5ed4a50e62 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:02.245411 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d209f642-30a3-450d-a6ed-ad5ed4a50e62 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:02.506262 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-d209f642-30a3-450d-a6ed-ad5ed4a50e62 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:02.516121 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-d209f642-30a3-450d-a6ed-ad5ed4a50e62 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:02.518209 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-d209f642-30a3-450d-a6ed-ad5ed4a50e62 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:02.519844 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-d209f642-30a3-450d-a6ed-ad5ed4a50e62 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54" status: 200 len: 1408 microversion: 2.20 time: 0.299219 Jul 22 11:16:02.520936 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 116/245] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:16:02 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 => generated 1408 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 22 11:16:02.776301 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [req-9be35eed-1434-41b0-9931-5a1bc2b569a2 req-8f475f74-7d17-453c-8ee1-c3832a735a4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f27dab8-c005-4dd0-b262-542deb60dd54", "tag": "019d06a1-2c6e-4ebb-b1f0-a080fc8a2fef"}]} {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:16:02.811048 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-9be35eed-1434-41b0-9931-5a1bc2b569a2 req-8f475f74-7d17-453c-8ee1-c3832a735a4d service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:02.813892 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-9be35eed-1434-41b0-9931-5a1bc2b569a2 req-8f475f74-7d17-453c-8ee1-c3832a735a4d service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:03.051504 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.compute.server_external_events [req-9be35eed-1434-41b0-9931-5a1bc2b569a2 req-8f475f74-7d17-453c-8ee1-c3832a735a4d service nova] Creating event network-changed:019d06a1-2c6e-4ebb-b1f0-a080fc8a2fef for instance 1f27dab8-c005-4dd0-b262-542deb60dd54 on hv-cinder-84890 Jul 22 11:16:03.054209 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-5a53130e-3355-4ed3-89ca-d10bd90b00e2 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:03.055520 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-5a53130e-3355-4ed3-89ca-d10bd90b00e2 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: fbf8cb41-3496-45fe-9392-6add8f6873d0] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:03.057423 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [req-9be35eed-1434-41b0-9931-5a1bc2b569a2 req-8f475f74-7d17-453c-8ee1-c3832a735a4d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.293111 Jul 22 11:16:03.058030 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 130/246] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:16:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:16:03.069220 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5a53130e-3355-4ed3-89ca-d10bd90b00e2 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:03.072041 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5a53130e-3355-4ed3-89ca-d10bd90b00e2 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:03.073314 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5a53130e-3355-4ed3-89ca-d10bd90b00e2 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:03.073953 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5a53130e-3355-4ed3-89ca-d10bd90b00e2 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:03.299421 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-0ea96aeb-ffa3-4049-9f2c-799ff1b7acb1 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:03.300299 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-0ea96aeb-ffa3-4049-9f2c-799ff1b7acb1 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 0501f722-7553-4cba-9675-7bcbabb72887] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:03.308190 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-0ea96aeb-ffa3-4049-9f2c-799ff1b7acb1 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:03.308975 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-0ea96aeb-ffa3-4049-9f2c-799ff1b7acb1 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:03.310012 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-0ea96aeb-ffa3-4049-9f2c-799ff1b7acb1 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:03.310677 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-0ea96aeb-ffa3-4049-9f2c-799ff1b7acb1 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:03.384069 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-0ea96aeb-ffa3-4049-9f2c-799ff1b7acb1 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887/ips" status: 200 len: 151 microversion: 2.1 time: 0.089507 Jul 22 11:16:03.384469 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 131/247] 10.222.0.20 () {58 vars in 1247 bytes} [Fri Jul 22 11:16:03 2022] GET /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887/ips => generated 151 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:16:03.446617 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-5a53130e-3355-4ed3-89ca-d10bd90b00e2 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:03.470905 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-5a53130e-3355-4ed3-89ca-d10bd90b00e2 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0" status: 200 len: 1522 microversion: 2.1 time: 0.431354 Jul 22 11:16:03.473873 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 117/248] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:03 2022] GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0 => generated 1522 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:16:03.542577 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-c723e67d-1ca3-4577-84b5-023f923127e8 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:03.543186 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-c723e67d-1ca3-4577-84b5-023f923127e8 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:03.549593 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c723e67d-1ca3-4577-84b5-023f923127e8 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:03.550426 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c723e67d-1ca3-4577-84b5-023f923127e8 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:03.551439 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c723e67d-1ca3-4577-84b5-023f923127e8 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:03.552053 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c723e67d-1ca3-4577-84b5-023f923127e8 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:03.898572 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-c723e67d-1ca3-4577-84b5-023f923127e8 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:03.931966 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-c723e67d-1ca3-4577-84b5-023f923127e8 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:03.933489 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-c723e67d-1ca3-4577-84b5-023f923127e8 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:03.934715 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-c723e67d-1ca3-4577-84b5-023f923127e8 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54" status: 200 len: 1408 microversion: 2.20 time: 0.395967 Jul 22 11:16:03.948186 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 132/249] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:16:03 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 => generated 1408 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:16:04.500759 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-fbdfe572-eda1-4825-9a83-45a75f9ec0a7 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:04.501918 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-fbdfe572-eda1-4825-9a83-45a75f9ec0a7 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: fbf8cb41-3496-45fe-9392-6add8f6873d0] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:04.518447 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fbdfe572-eda1-4825-9a83-45a75f9ec0a7 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:04.521605 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fbdfe572-eda1-4825-9a83-45a75f9ec0a7 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:04.522770 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fbdfe572-eda1-4825-9a83-45a75f9ec0a7 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:04.525316 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fbdfe572-eda1-4825-9a83-45a75f9ec0a7 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:04.912612 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-fbdfe572-eda1-4825-9a83-45a75f9ec0a7 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:04.931381 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-fbdfe572-eda1-4825-9a83-45a75f9ec0a7 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0" status: 200 len: 1522 microversion: 2.1 time: 0.437893 Jul 22 11:16:04.947597 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 118/250] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:04 2022] GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0 => generated 1522 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:16:04.982219 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-61b4a1e3-3e77-4f3f-be25-eff4ea60b661 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:04.984920 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-61b4a1e3-3e77-4f3f-be25-eff4ea60b661 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:04.997640 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-61b4a1e3-3e77-4f3f-be25-eff4ea60b661 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:04.999029 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-61b4a1e3-3e77-4f3f-be25-eff4ea60b661 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:05.000076 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-61b4a1e3-3e77-4f3f-be25-eff4ea60b661 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:05.001560 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-61b4a1e3-3e77-4f3f-be25-eff4ea60b661 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:05.429154 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-61b4a1e3-3e77-4f3f-be25-eff4ea60b661 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:05.438944 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-61b4a1e3-3e77-4f3f-be25-eff4ea60b661 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:05.440807 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-61b4a1e3-3e77-4f3f-be25-eff4ea60b661 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:05.442388 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-61b4a1e3-3e77-4f3f-be25-eff4ea60b661 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54" status: 200 len: 1408 microversion: 2.20 time: 0.469883 Jul 22 11:16:05.444111 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 133/251] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:16:04 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 => generated 1408 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:16:05.535521 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-a3b53cb5-dbc1-4125-b205-8e87aae99288 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c991934f-a2a3-4c93-b91f-c324e9fc433e"}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:16:05.538436 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-a3b53cb5-dbc1-4125-b205-8e87aae99288 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 0501f722-7553-4cba-9675-7bcbabb72887] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:05.544819 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a3b53cb5-dbc1-4125-b205-8e87aae99288 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:05.545443 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a3b53cb5-dbc1-4125-b205-8e87aae99288 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:05.546239 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a3b53cb5-dbc1-4125-b205-8e87aae99288 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:05.546675 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a3b53cb5-dbc1-4125-b205-8e87aae99288 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:05.964953 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-924f406c-2871-4946-b94f-de85ed8deaaa tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:05.966088 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-924f406c-2871-4946-b94f-de85ed8deaaa tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: fbf8cb41-3496-45fe-9392-6add8f6873d0] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:05.985793 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-924f406c-2871-4946-b94f-de85ed8deaaa tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:05.987403 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-924f406c-2871-4946-b94f-de85ed8deaaa tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:05.991456 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-924f406c-2871-4946-b94f-de85ed8deaaa tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:05.991947 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-924f406c-2871-4946-b94f-de85ed8deaaa tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:06.106834 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-a3b53cb5-dbc1-4125-b205-8e87aae99288 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "POST /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.578733 Jul 22 11:16:06.115088 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 119/252] 10.222.0.20 () {60 vars in 1322 bytes} [Fri Jul 22 11:16:05 2022] POST /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887/os-volume_attachments => generated 194 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:16:06.305270 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-924f406c-2871-4946-b94f-de85ed8deaaa tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:06.316247 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-924f406c-2871-4946-b94f-de85ed8deaaa tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0" status: 200 len: 1522 microversion: 2.1 time: 0.358120 Jul 22 11:16:06.317470 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 134/253] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:05 2022] GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0 => generated 1522 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:16:06.423035 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-f569a955-08e2-4fb7-8e80-e61ac17a5fe1 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Action: 'create', calling method: .version_select at 0x7f8445459670>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-468330005", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI4OoH1PGdeSSzhiissFNzZrBeSWnj7zBZWpV4khK0V7DbJlxrvhVUf+1+xI3FXTV/8yvxpqQ20zwmaXMPU7pgq8CAJW2u5acjEaCP4+nTL24FABasGxqn9BRMeuYMpmDQ=="}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:16:06.457064 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-f569a955-08e2-4fb7-8e80-e61ac17a5fe1 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Getting quotas for project a84fa2f397c54be1b409d8be5ebc8491. Resources: {'key_pairs'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 22 11:16:06.465778 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-f569a955-08e2-4fb7-8e80-e61ac17a5fe1 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Getting quotas for user e908d2b09dfc4a139d9c27f52580e15b and project a84fa2f397c54be1b409d8be5ebc8491. Resources: {'key_pairs'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 22 11:16:06.470146 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-513c3ef1-84df-4a6e-abfe-821b1c47efc9 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:06.471193 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-513c3ef1-84df-4a6e-abfe-821b1c47efc9 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:06.481218 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-513c3ef1-84df-4a6e-abfe-821b1c47efc9 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:06.481830 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell0:SELECT=2 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:16:06.482063 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-513c3ef1-84df-4a6e-abfe-821b1c47efc9 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:06.483516 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-513c3ef1-84df-4a6e-abfe-821b1c47efc9 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:06.484314 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-513c3ef1-84df-4a6e-abfe-821b1c47efc9 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:06.512990 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-f569a955-08e2-4fb7-8e80-e61ac17a5fe1 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.104479 Jul 22 11:16:06.514829 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 120/254] 10.222.0.20 () {60 vars in 1158 bytes} [Fri Jul 22 11:16:06 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:16:06.697839 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-e53288d2-7937-442b-9e52-32e16f43c277 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2146514566", "imageRef": "7cc31588-7647-4ff7-a8d9-b3487d83c94d", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-468330005", "networks": [{"uuid": "c683c538-31ff-4cd6-a39f-980bbec88da0"}]}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:16:06.725585 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-513c3ef1-84df-4a6e-abfe-821b1c47efc9 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:06.750028 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-513c3ef1-84df-4a6e-abfe-821b1c47efc9 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:06.752978 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-513c3ef1-84df-4a6e-abfe-821b1c47efc9 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:06.755093 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-513c3ef1-84df-4a6e-abfe-821b1c47efc9 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54" status: 200 len: 1408 microversion: 2.20 time: 0.289554 Jul 22 11:16:06.767804 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 135/255] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:16:06 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 => generated 1408 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:16:06.791989 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.network.neutron [None req-e53288d2-7937-442b-9e52-32e16f43c277 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] validate_networks() for [('c683c538-31ff-4cd6-a39f-980bbec88da0', None, None, None, None, None)] {{(pid=117885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 22 11:16:07.307435 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-e53288d2-7937-442b-9e52-32e16f43c277 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Flavor limits 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 22 11:16:07.308131 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-e53288d2-7937-442b-9e52-32e16f43c277 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Image limits 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 22 11:16:07.308933 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-e53288d2-7937-442b-9e52-32e16f43c277 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Flavor pref 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 22 11:16:07.309343 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-e53288d2-7937-442b-9e52-32e16f43c277 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Image pref 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 22 11:16:07.309745 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-e53288d2-7937-442b-9e52-32e16f43c277 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 22 11:16:07.319153 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e53288d2-7937-442b-9e52-32e16f43c277 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:07.319631 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e53288d2-7937-442b-9e52-32e16f43c277 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:07.320431 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e53288d2-7937-442b-9e52-32e16f43c277 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:07.320865 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e53288d2-7937-442b-9e52-32e16f43c277 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:07.340119 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-e53288d2-7937-442b-9e52-32e16f43c277 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Getting quotas for project a84fa2f397c54be1b409d8be5ebc8491. Resources: {'instances', 'cores', 'ram'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 22 11:16:07.347172 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-e53288d2-7937-442b-9e52-32e16f43c277 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Getting quotas for user e908d2b09dfc4a139d9c27f52580e15b and project a84fa2f397c54be1b409d8be5ebc8491. Resources: {'instances', 'cores', 'ram'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 22 11:16:07.347496 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-df27cde1-026e-4437-97c8-9e0495418225 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:07.348978 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-df27cde1-026e-4437-97c8-9e0495418225 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: fbf8cb41-3496-45fe-9392-6add8f6873d0] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:07.356478 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-df27cde1-026e-4437-97c8-9e0495418225 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:07.356936 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-df27cde1-026e-4437-97c8-9e0495418225 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:07.358359 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-df27cde1-026e-4437-97c8-9e0495418225 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:07.359091 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-df27cde1-026e-4437-97c8-9e0495418225 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:07.366643 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-e53288d2-7937-442b-9e52-32e16f43c277 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Going to run 1 instances... {{(pid=117885) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 22 11:16:07.375565 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-e53288d2-7937-442b-9e52-32e16f43c277 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] [instance: 39fe8666-e4cc-464c-9af9-bd43835bccf6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7cc31588-7647-4ff7-a8d9-b3487d83c94d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 22 11:16:07.461261 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-e53288d2-7937-442b-9e52-32e16f43c277 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.770674 Jul 22 11:16:07.462387 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 121/256] 10.222.0.20 () {60 vars in 1146 bytes} [Fri Jul 22 11:16:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 773 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 22 11:16:07.480542 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-f87b5c29-17aa-4001-94c5-94ba202f06f5 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:07.481963 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-f87b5c29-17aa-4001-94c5-94ba202f06f5 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] [instance: 39fe8666-e4cc-464c-9af9-bd43835bccf6] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:07.557548 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-f87b5c29-17aa-4001-94c5-94ba202f06f5 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e908d2b09dfc4a139d9c27f52580e15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84fa2f397c54be1b409d8be5ebc8491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:07.577646 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-f87b5c29-17aa-4001-94c5-94ba202f06f5 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] 10.222.0.20 "GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6" status: 200 len: 1258 microversion: 2.1 time: 0.103890 Jul 22 11:16:07.578590 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 122/257] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:07 2022] GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6 => generated 1258 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:16:07.629147 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-df27cde1-026e-4437-97c8-9e0495418225 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:07.646726 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-df27cde1-026e-4437-97c8-9e0495418225 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0" status: 200 len: 1522 microversion: 2.1 time: 0.304057 Jul 22 11:16:07.649265 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 136/258] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:07 2022] GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0 => generated 1522 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:16:07.783249 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-f5d6a45d-3d6b-4a13-ab0f-279052927381 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:07.784457 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-f5d6a45d-3d6b-4a13-ab0f-279052927381 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:07.792554 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f5d6a45d-3d6b-4a13-ab0f-279052927381 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:07.793482 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f5d6a45d-3d6b-4a13-ab0f-279052927381 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:07.794272 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f5d6a45d-3d6b-4a13-ab0f-279052927381 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:07.795649 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f5d6a45d-3d6b-4a13-ab0f-279052927381 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:07.987695 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-f5d6a45d-3d6b-4a13-ab0f-279052927381 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:08.002743 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-f5d6a45d-3d6b-4a13-ab0f-279052927381 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:08.006802 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-f5d6a45d-3d6b-4a13-ab0f-279052927381 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:08.009388 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-f5d6a45d-3d6b-4a13-ab0f-279052927381 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54" status: 200 len: 1408 microversion: 2.20 time: 0.230356 Jul 22 11:16:08.010708 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 123/259] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:16:07 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 => generated 1408 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 22 11:16:08.613106 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-a05c8c70-03d8-456a-b999-3e7b33ba744a tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:08.614699 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-a05c8c70-03d8-456a-b999-3e7b33ba744a tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] [instance: 39fe8666-e4cc-464c-9af9-bd43835bccf6] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:08.632115 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-a05c8c70-03d8-456a-b999-3e7b33ba744a tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:08.632805 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-a05c8c70-03d8-456a-b999-3e7b33ba744a tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:08.634080 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-a05c8c70-03d8-456a-b999-3e7b33ba744a tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:08.634779 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-a05c8c70-03d8-456a-b999-3e7b33ba744a tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:08.671849 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-2a80c162-b22e-49cb-9c39-2742b7c6c1eb tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:08.672583 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-2a80c162-b22e-49cb-9c39-2742b7c6c1eb tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: fbf8cb41-3496-45fe-9392-6add8f6873d0] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:08.682376 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2a80c162-b22e-49cb-9c39-2742b7c6c1eb tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:08.683225 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2a80c162-b22e-49cb-9c39-2742b7c6c1eb tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:08.684665 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2a80c162-b22e-49cb-9c39-2742b7c6c1eb tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:08.685387 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2a80c162-b22e-49cb-9c39-2742b7c6c1eb tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:08.732129 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-a05c8c70-03d8-456a-b999-3e7b33ba744a tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e908d2b09dfc4a139d9c27f52580e15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84fa2f397c54be1b409d8be5ebc8491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:08.742402 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-a05c8c70-03d8-456a-b999-3e7b33ba744a tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] 10.222.0.20 "GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6" status: 200 len: 1310 microversion: 2.1 time: 0.136497 Jul 22 11:16:08.743300 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 137/260] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:08 2022] GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6 => generated 1310 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:16:08.907192 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-2a80c162-b22e-49cb-9c39-2742b7c6c1eb tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:08.926720 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-2a80c162-b22e-49cb-9c39-2742b7c6c1eb tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0" status: 200 len: 1522 microversion: 2.1 time: 0.257858 Jul 22 11:16:08.929882 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 124/261] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:08 2022] GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0 => generated 1522 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:16:09.035045 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-3d4ddf5a-a4e7-44ae-877f-8c7fd0f97f62 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:09.035860 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-3d4ddf5a-a4e7-44ae-877f-8c7fd0f97f62 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:09.050297 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-3d4ddf5a-a4e7-44ae-877f-8c7fd0f97f62 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:09.057121 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-3d4ddf5a-a4e7-44ae-877f-8c7fd0f97f62 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:09.058263 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-3d4ddf5a-a4e7-44ae-877f-8c7fd0f97f62 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:09.058703 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-3d4ddf5a-a4e7-44ae-877f-8c7fd0f97f62 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:09.334399 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-3d4ddf5a-a4e7-44ae-877f-8c7fd0f97f62 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:09.350092 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-3d4ddf5a-a4e7-44ae-877f-8c7fd0f97f62 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:09.353168 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-3d4ddf5a-a4e7-44ae-877f-8c7fd0f97f62 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:09.355336 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-3d4ddf5a-a4e7-44ae-877f-8c7fd0f97f62 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54" status: 200 len: 1408 microversion: 2.20 time: 0.326480 Jul 22 11:16:09.356374 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 138/262] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:16:09 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 => generated 1408 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 22 11:16:09.767451 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-c1e0568f-27c4-4281-94ec-ee5eef909e3b tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:09.768322 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-c1e0568f-27c4-4281-94ec-ee5eef909e3b tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] [instance: 39fe8666-e4cc-464c-9af9-bd43835bccf6] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:09.782999 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c1e0568f-27c4-4281-94ec-ee5eef909e3b tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:09.784195 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c1e0568f-27c4-4281-94ec-ee5eef909e3b tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:09.786214 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c1e0568f-27c4-4281-94ec-ee5eef909e3b tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:09.787569 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c1e0568f-27c4-4281-94ec-ee5eef909e3b tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:09.923167 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-c1e0568f-27c4-4281-94ec-ee5eef909e3b tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e908d2b09dfc4a139d9c27f52580e15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84fa2f397c54be1b409d8be5ebc8491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:09.941913 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-c1e0568f-27c4-4281-94ec-ee5eef909e3b tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] 10.222.0.20 "GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6" status: 200 len: 1316 microversion: 2.1 time: 0.175693 Jul 22 11:16:09.943730 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 125/263] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:09 2022] GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6 => generated 1316 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:16:09.949580 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-0f434420-947a-4728-ad58-f50abde696bf tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:09.950526 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-0f434420-947a-4728-ad58-f50abde696bf tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: fbf8cb41-3496-45fe-9392-6add8f6873d0] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:09.971053 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-0f434420-947a-4728-ad58-f50abde696bf tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:09.971817 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-0f434420-947a-4728-ad58-f50abde696bf tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:09.972795 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-0f434420-947a-4728-ad58-f50abde696bf tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:09.973381 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-0f434420-947a-4728-ad58-f50abde696bf tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:09.999212 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG dbcounter [-] [117884] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:16:10.264636 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-0f434420-947a-4728-ad58-f50abde696bf tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:10.281553 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-0f434420-947a-4728-ad58-f50abde696bf tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0" status: 200 len: 1522 microversion: 2.1 time: 0.337700 Jul 22 11:16:10.282455 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 139/264] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:09 2022] GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0 => generated 1522 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:16:10.382726 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-455b9d3d-1c20-4a0b-8e04-bafe2c9f521a tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:10.383600 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-455b9d3d-1c20-4a0b-8e04-bafe2c9f521a tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:10.394185 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-455b9d3d-1c20-4a0b-8e04-bafe2c9f521a tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:10.394770 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-455b9d3d-1c20-4a0b-8e04-bafe2c9f521a tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:10.396102 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-455b9d3d-1c20-4a0b-8e04-bafe2c9f521a tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:10.396945 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-455b9d3d-1c20-4a0b-8e04-bafe2c9f521a tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:10.572232 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-455b9d3d-1c20-4a0b-8e04-bafe2c9f521a tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:10.581075 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-455b9d3d-1c20-4a0b-8e04-bafe2c9f521a tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:10.582769 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-455b9d3d-1c20-4a0b-8e04-bafe2c9f521a tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:10.583934 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-455b9d3d-1c20-4a0b-8e04-bafe2c9f521a tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54" status: 200 len: 1408 microversion: 2.20 time: 0.208748 Jul 22 11:16:10.584758 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 126/265] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:16:10 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 => generated 1408 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:16:10.967676 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-1f6d14d4-1e35-4274-9e1f-99c84f9b9242 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:10.968521 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-1f6d14d4-1e35-4274-9e1f-99c84f9b9242 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] [instance: 39fe8666-e4cc-464c-9af9-bd43835bccf6] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:10.974876 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-1f6d14d4-1e35-4274-9e1f-99c84f9b9242 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:10.975353 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-1f6d14d4-1e35-4274-9e1f-99c84f9b9242 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:10.976143 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-1f6d14d4-1e35-4274-9e1f-99c84f9b9242 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:10.976571 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-1f6d14d4-1e35-4274-9e1f-99c84f9b9242 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:11.141930 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-1f6d14d4-1e35-4274-9e1f-99c84f9b9242 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e908d2b09dfc4a139d9c27f52580e15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84fa2f397c54be1b409d8be5ebc8491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:11.151319 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-1f6d14d4-1e35-4274-9e1f-99c84f9b9242 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] 10.222.0.20 "GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6" status: 200 len: 1358 microversion: 2.1 time: 0.188059 Jul 22 11:16:11.152010 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 140/266] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:10 2022] GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6 => generated 1358 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:16:11.298248 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-2434b3bd-f207-4b05-8ab5-c7cd03473938 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:11.298845 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-2434b3bd-f207-4b05-8ab5-c7cd03473938 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: fbf8cb41-3496-45fe-9392-6add8f6873d0] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:11.309002 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2434b3bd-f207-4b05-8ab5-c7cd03473938 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:11.309680 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2434b3bd-f207-4b05-8ab5-c7cd03473938 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:11.311604 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2434b3bd-f207-4b05-8ab5-c7cd03473938 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:11.312283 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2434b3bd-f207-4b05-8ab5-c7cd03473938 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:11.481632 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-2434b3bd-f207-4b05-8ab5-c7cd03473938 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:11.490881 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-2434b3bd-f207-4b05-8ab5-c7cd03473938 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0" status: 200 len: 1522 microversion: 2.1 time: 0.196428 Jul 22 11:16:11.491514 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 127/267] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:11 2022] GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0 => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:16:11.611679 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-29829400-4dcc-4b99-9696-e4ce4ff8dc51 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:11.612671 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-29829400-4dcc-4b99-9696-e4ce4ff8dc51 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:11.621543 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-29829400-4dcc-4b99-9696-e4ce4ff8dc51 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:11.621983 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-29829400-4dcc-4b99-9696-e4ce4ff8dc51 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:11.622812 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-29829400-4dcc-4b99-9696-e4ce4ff8dc51 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:11.623766 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-29829400-4dcc-4b99-9696-e4ce4ff8dc51 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:11.797759 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-29829400-4dcc-4b99-9696-e4ce4ff8dc51 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:11.809385 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-29829400-4dcc-4b99-9696-e4ce4ff8dc51 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:11.811673 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-29829400-4dcc-4b99-9696-e4ce4ff8dc51 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:11.813511 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-29829400-4dcc-4b99-9696-e4ce4ff8dc51 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54" status: 200 len: 1408 microversion: 2.20 time: 0.208603 Jul 22 11:16:11.814094 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 141/268] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:16:11 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 => generated 1408 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:16:12.174657 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-87ab4939-86fc-4506-8244-4a88f4f207c9 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:12.175761 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-87ab4939-86fc-4506-8244-4a88f4f207c9 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] [instance: 39fe8666-e4cc-464c-9af9-bd43835bccf6] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:12.183569 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-87ab4939-86fc-4506-8244-4a88f4f207c9 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:12.184081 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-87ab4939-86fc-4506-8244-4a88f4f207c9 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:12.184937 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-87ab4939-86fc-4506-8244-4a88f4f207c9 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:12.185417 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-87ab4939-86fc-4506-8244-4a88f4f207c9 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:12.352080 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-87ab4939-86fc-4506-8244-4a88f4f207c9 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e908d2b09dfc4a139d9c27f52580e15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84fa2f397c54be1b409d8be5ebc8491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:12.359964 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-87ab4939-86fc-4506-8244-4a88f4f207c9 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] 10.222.0.20 "GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6" status: 200 len: 1358 microversion: 2.1 time: 0.193532 Jul 22 11:16:12.360822 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 128/269] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:12 2022] GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6 => generated 1358 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:16:12.509945 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-b3b80ae7-8f6a-48e1-b7b0-f54ee5677618 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:12.511048 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-b3b80ae7-8f6a-48e1-b7b0-f54ee5677618 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: fbf8cb41-3496-45fe-9392-6add8f6873d0] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:12.521765 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-b3b80ae7-8f6a-48e1-b7b0-f54ee5677618 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:12.522263 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-b3b80ae7-8f6a-48e1-b7b0-f54ee5677618 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:12.523089 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-b3b80ae7-8f6a-48e1-b7b0-f54ee5677618 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:12.523589 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-b3b80ae7-8f6a-48e1-b7b0-f54ee5677618 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:12.710634 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-b3b80ae7-8f6a-48e1-b7b0-f54ee5677618 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:12.728520 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-b3b80ae7-8f6a-48e1-b7b0-f54ee5677618 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0" status: 200 len: 1522 microversion: 2.1 time: 0.223359 Jul 22 11:16:12.730652 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 142/270] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:12 2022] GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0 => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:16:12.833331 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-3e85c150-b474-488b-b700-8a695d5b4fcd tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:12.834236 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-3e85c150-b474-488b-b700-8a695d5b4fcd tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:12.843551 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3e85c150-b474-488b-b700-8a695d5b4fcd tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:12.844285 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3e85c150-b474-488b-b700-8a695d5b4fcd tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:12.845636 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3e85c150-b474-488b-b700-8a695d5b4fcd tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:12.846365 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3e85c150-b474-488b-b700-8a695d5b4fcd tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:13.077767 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-3e85c150-b474-488b-b700-8a695d5b4fcd tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:13.087274 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-3e85c150-b474-488b-b700-8a695d5b4fcd tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:13.089556 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-3e85c150-b474-488b-b700-8a695d5b4fcd tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:13.091313 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-3e85c150-b474-488b-b700-8a695d5b4fcd tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54" status: 200 len: 1408 microversion: 2.20 time: 0.262408 Jul 22 11:16:13.092812 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 129/271] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:16:12 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 => generated 1408 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 22 11:16:13.378694 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-54a0b03b-af45-48f7-a820-8cf22552f864 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:13.379496 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-54a0b03b-af45-48f7-a820-8cf22552f864 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] [instance: 39fe8666-e4cc-464c-9af9-bd43835bccf6] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:13.388773 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-54a0b03b-af45-48f7-a820-8cf22552f864 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:13.389570 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-54a0b03b-af45-48f7-a820-8cf22552f864 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:13.390945 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-54a0b03b-af45-48f7-a820-8cf22552f864 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:13.391727 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-54a0b03b-af45-48f7-a820-8cf22552f864 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:13.761320 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-54a0b03b-af45-48f7-a820-8cf22552f864 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e908d2b09dfc4a139d9c27f52580e15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84fa2f397c54be1b409d8be5ebc8491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:13.769813 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-a1a5378f-cbbe-4275-b657-bbc717e5acb8 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:13.775316 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-a1a5378f-cbbe-4275-b657-bbc717e5acb8 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: fbf8cb41-3496-45fe-9392-6add8f6873d0] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:13.813539 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-54a0b03b-af45-48f7-a820-8cf22552f864 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] 10.222.0.20 "GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6" status: 200 len: 1358 microversion: 2.1 time: 0.434968 Jul 22 11:16:13.814442 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 143/272] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:13 2022] GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6 => generated 1358 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:16:13.816929 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a1a5378f-cbbe-4275-b657-bbc717e5acb8 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:13.818749 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a1a5378f-cbbe-4275-b657-bbc717e5acb8 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:13.820022 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a1a5378f-cbbe-4275-b657-bbc717e5acb8 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:13.820466 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a1a5378f-cbbe-4275-b657-bbc717e5acb8 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:14.122363 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-0a320c5c-c1c0-4120-9c06-b8362ab8e10b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:14.124329 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-0a320c5c-c1c0-4120-9c06-b8362ab8e10b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:14.139315 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-a1a5378f-cbbe-4275-b657-bbc717e5acb8 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:14.143899 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:16:14.145368 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-0a320c5c-c1c0-4120-9c06-b8362ab8e10b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:14.145843 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-0a320c5c-c1c0-4120-9c06-b8362ab8e10b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:14.146621 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-0a320c5c-c1c0-4120-9c06-b8362ab8e10b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:14.147040 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-0a320c5c-c1c0-4120-9c06-b8362ab8e10b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:14.157928 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-a1a5378f-cbbe-4275-b657-bbc717e5acb8 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0" status: 200 len: 1522 microversion: 2.1 time: 0.406998 Jul 22 11:16:14.168179 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 130/273] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:13 2022] GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0 => generated 1522 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:16:14.348384 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-0a320c5c-c1c0-4120-9c06-b8362ab8e10b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:14.360009 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-0a320c5c-c1c0-4120-9c06-b8362ab8e10b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:14.362763 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-0a320c5c-c1c0-4120-9c06-b8362ab8e10b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:14.364598 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-0a320c5c-c1c0-4120-9c06-b8362ab8e10b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54" status: 200 len: 1408 microversion: 2.20 time: 0.248743 Jul 22 11:16:14.365734 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 144/274] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:16:14 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 => generated 1408 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 22 11:16:14.844459 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-2026fe73-829b-4adf-b931-5b2dd6cd6d51 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:14.846550 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-2026fe73-829b-4adf-b931-5b2dd6cd6d51 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] [instance: 39fe8666-e4cc-464c-9af9-bd43835bccf6] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:14.858259 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2026fe73-829b-4adf-b931-5b2dd6cd6d51 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:14.858894 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2026fe73-829b-4adf-b931-5b2dd6cd6d51 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:14.859755 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2026fe73-829b-4adf-b931-5b2dd6cd6d51 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:14.860228 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2026fe73-829b-4adf-b931-5b2dd6cd6d51 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:15.055103 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-2026fe73-829b-4adf-b931-5b2dd6cd6d51 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e908d2b09dfc4a139d9c27f52580e15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84fa2f397c54be1b409d8be5ebc8491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:15.069962 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-2026fe73-829b-4adf-b931-5b2dd6cd6d51 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] 10.222.0.20 "GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6" status: 200 len: 1358 microversion: 2.1 time: 0.232096 Jul 22 11:16:15.087618 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 131/275] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:14 2022] GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6 => generated 1358 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:16:15.178310 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-4f50ef68-c4ab-42d4-956d-fb02857f19eb tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:15.180259 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-4f50ef68-c4ab-42d4-956d-fb02857f19eb tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: fbf8cb41-3496-45fe-9392-6add8f6873d0] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:15.189782 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-4f50ef68-c4ab-42d4-956d-fb02857f19eb tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:15.190561 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-4f50ef68-c4ab-42d4-956d-fb02857f19eb tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:15.191373 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-4f50ef68-c4ab-42d4-956d-fb02857f19eb tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:15.191839 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-4f50ef68-c4ab-42d4-956d-fb02857f19eb tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:15.332435 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-4f50ef68-c4ab-42d4-956d-fb02857f19eb tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:15.343025 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-4f50ef68-c4ab-42d4-956d-fb02857f19eb tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0" status: 200 len: 1522 microversion: 2.1 time: 0.169964 Jul 22 11:16:15.354134 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 145/276] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:15 2022] GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:16:15.385593 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-ec21217b-d0ae-42b4-9199-429128576680 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:15.386764 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-ec21217b-d0ae-42b4-9199-429128576680 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:15.396013 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ec21217b-d0ae-42b4-9199-429128576680 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:15.396727 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ec21217b-d0ae-42b4-9199-429128576680 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:15.397767 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ec21217b-d0ae-42b4-9199-429128576680 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:15.398340 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ec21217b-d0ae-42b4-9199-429128576680 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:15.720120 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-ec21217b-d0ae-42b4-9199-429128576680 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:15.739199 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-ec21217b-d0ae-42b4-9199-429128576680 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:15.741184 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-ec21217b-d0ae-42b4-9199-429128576680 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:15.743122 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-ec21217b-d0ae-42b4-9199-429128576680 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54" status: 200 len: 1408 microversion: 2.20 time: 0.363650 Jul 22 11:16:15.749372 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 132/277] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:16:15 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 => generated 1408 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:16:16.104536 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-09070c16-2637-4dfe-975f-e6db9bf8d479 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:16.105618 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-09070c16-2637-4dfe-975f-e6db9bf8d479 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] [instance: 39fe8666-e4cc-464c-9af9-bd43835bccf6] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:16.112982 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-09070c16-2637-4dfe-975f-e6db9bf8d479 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:16.113576 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-09070c16-2637-4dfe-975f-e6db9bf8d479 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:16.114714 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-09070c16-2637-4dfe-975f-e6db9bf8d479 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:16.115245 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-09070c16-2637-4dfe-975f-e6db9bf8d479 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:16.322994 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-09070c16-2637-4dfe-975f-e6db9bf8d479 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e908d2b09dfc4a139d9c27f52580e15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84fa2f397c54be1b409d8be5ebc8491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:16.340056 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-09070c16-2637-4dfe-975f-e6db9bf8d479 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] 10.222.0.20 "GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6" status: 200 len: 1358 microversion: 2.1 time: 0.248058 Jul 22 11:16:16.342049 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 146/278] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:16 2022] GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6 => generated 1358 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:16:16.363710 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-ae8f2f78-3bd1-4f97-8ccb-2fa40faff621 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:16.365029 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-ae8f2f78-3bd1-4f97-8ccb-2fa40faff621 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: fbf8cb41-3496-45fe-9392-6add8f6873d0] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:16.374764 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ae8f2f78-3bd1-4f97-8ccb-2fa40faff621 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:16.375407 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ae8f2f78-3bd1-4f97-8ccb-2fa40faff621 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:16.376456 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ae8f2f78-3bd1-4f97-8ccb-2fa40faff621 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:16.377074 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ae8f2f78-3bd1-4f97-8ccb-2fa40faff621 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:16.556501 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-ae8f2f78-3bd1-4f97-8ccb-2fa40faff621 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:16.565272 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-ae8f2f78-3bd1-4f97-8ccb-2fa40faff621 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0" status: 200 len: 1522 microversion: 2.1 time: 0.207112 Jul 22 11:16:16.565882 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 133/279] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:16 2022] GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0 => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:16:16.774566 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-298a1d8f-937e-4e1f-b081-9e41a1711de6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:16.775432 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-298a1d8f-937e-4e1f-b081-9e41a1711de6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:16.798292 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-298a1d8f-937e-4e1f-b081-9e41a1711de6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:16.802700 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-298a1d8f-937e-4e1f-b081-9e41a1711de6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:16.804595 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-298a1d8f-937e-4e1f-b081-9e41a1711de6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:16.811091 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-298a1d8f-937e-4e1f-b081-9e41a1711de6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:16.852861 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-9d68e22f-f5a5-41f0-a2d2-ad3be56c9643 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:16.856213 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-9d68e22f-f5a5-41f0-a2d2-ad3be56c9643 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:16.869771 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9d68e22f-f5a5-41f0-a2d2-ad3be56c9643 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:16.870735 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9d68e22f-f5a5-41f0-a2d2-ad3be56c9643 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:16.872252 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9d68e22f-f5a5-41f0-a2d2-ad3be56c9643 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:16.873213 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9d68e22f-f5a5-41f0-a2d2-ad3be56c9643 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:16.901921 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-9d68e22f-f5a5-41f0-a2d2-ad3be56c9643 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1/ips" status: 200 len: 146 microversion: 2.1 time: 0.056758 Jul 22 11:16:16.902511 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 134/280] 10.222.0.20 () {58 vars in 1247 bytes} [Fri Jul 22 11:16:16 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1/ips => generated 146 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:16:17.027568 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-298a1d8f-937e-4e1f-b081-9e41a1711de6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:17.036867 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-298a1d8f-937e-4e1f-b081-9e41a1711de6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:17.038399 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-298a1d8f-937e-4e1f-b081-9e41a1711de6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:17.039584 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-298a1d8f-937e-4e1f-b081-9e41a1711de6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54" status: 200 len: 1408 microversion: 2.20 time: 0.269026 Jul 22 11:16:17.040160 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 147/281] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:16:16 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 => generated 1408 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:16:17.357485 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-ea663257-dbf0-4caa-b351-8e7a855af28f tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:17.358368 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-ea663257-dbf0-4caa-b351-8e7a855af28f tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] [instance: 39fe8666-e4cc-464c-9af9-bd43835bccf6] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:17.360358 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell0:SELECT=2 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:16:17.367863 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ea663257-dbf0-4caa-b351-8e7a855af28f tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:17.368724 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ea663257-dbf0-4caa-b351-8e7a855af28f tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:17.369092 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ea663257-dbf0-4caa-b351-8e7a855af28f tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:17.369576 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ea663257-dbf0-4caa-b351-8e7a855af28f tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:17.557724 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-ea663257-dbf0-4caa-b351-8e7a855af28f tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e908d2b09dfc4a139d9c27f52580e15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84fa2f397c54be1b409d8be5ebc8491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:17.561983 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell0:SELECT=24 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:16:17.568020 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-ea663257-dbf0-4caa-b351-8e7a855af28f tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] 10.222.0.20 "GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6" status: 200 len: 1358 microversion: 2.1 time: 0.214334 Jul 22 11:16:17.568785 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 135/282] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:17 2022] GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6 => generated 1358 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:16:17.585341 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-ed48d561-d2f9-404d-825a-4f7b546906cb tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:17.587650 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-ed48d561-d2f9-404d-825a-4f7b546906cb tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: fbf8cb41-3496-45fe-9392-6add8f6873d0] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:17.595712 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-ed48d561-d2f9-404d-825a-4f7b546906cb tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:17.596579 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-ed48d561-d2f9-404d-825a-4f7b546906cb tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:17.598048 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-ed48d561-d2f9-404d-825a-4f7b546906cb tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:17.598779 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-ed48d561-d2f9-404d-825a-4f7b546906cb tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:17.846376 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-ed48d561-d2f9-404d-825a-4f7b546906cb tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:17.861333 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-ed48d561-d2f9-404d-825a-4f7b546906cb tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0" status: 200 len: 1522 microversion: 2.1 time: 0.280437 Jul 22 11:16:17.863232 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 148/283] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:17 2022] GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0 => generated 1522 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:16:18.063870 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-4836a729-faa3-43b6-9bf2-86fd49a0f4d0 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:18.064791 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-4836a729-faa3-43b6-9bf2-86fd49a0f4d0 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:18.071293 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4836a729-faa3-43b6-9bf2-86fd49a0f4d0 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:18.071754 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4836a729-faa3-43b6-9bf2-86fd49a0f4d0 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:18.072613 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4836a729-faa3-43b6-9bf2-86fd49a0f4d0 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:18.072972 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4836a729-faa3-43b6-9bf2-86fd49a0f4d0 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:18.332396 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [req-dcf2f25c-8b9b-4e5e-857d-b3bdc6a19451 req-62d6820c-f936-4404-ad57-9429d435602b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f27dab8-c005-4dd0-b262-542deb60dd54", "name": "network-vif-plugged", "status": "completed", "tag": "019d06a1-2c6e-4ebb-b1f0-a080fc8a2fef"}]} {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:16:18.361767 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-4836a729-faa3-43b6-9bf2-86fd49a0f4d0 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:18.364837 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-dcf2f25c-8b9b-4e5e-857d-b3bdc6a19451 req-62d6820c-f936-4404-ad57-9429d435602b service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:18.365689 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-dcf2f25c-8b9b-4e5e-857d-b3bdc6a19451 req-62d6820c-f936-4404-ad57-9429d435602b service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:18.382657 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-4836a729-faa3-43b6-9bf2-86fd49a0f4d0 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:18.386456 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-4836a729-faa3-43b6-9bf2-86fd49a0f4d0 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:18.388880 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-4836a729-faa3-43b6-9bf2-86fd49a0f4d0 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54" status: 200 len: 1408 microversion: 2.20 time: 0.332921 Jul 22 11:16:18.389895 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 136/284] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:16:18 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 => generated 1408 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:16:18.394313 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.compute.server_external_events [req-dcf2f25c-8b9b-4e5e-857d-b3bdc6a19451 req-62d6820c-f936-4404-ad57-9429d435602b service nova] Creating event network-vif-plugged:019d06a1-2c6e-4ebb-b1f0-a080fc8a2fef for instance 1f27dab8-c005-4dd0-b262-542deb60dd54 on hv-cinder-84890 Jul 22 11:16:18.408474 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [req-dcf2f25c-8b9b-4e5e-857d-b3bdc6a19451 req-62d6820c-f936-4404-ad57-9429d435602b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082120 Jul 22 11:16:18.409588 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 149/285] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:16:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:16:18.589442 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-37312812-ad58-4fcd-8d7a-cb93ebe3d39b tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:18.590711 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-37312812-ad58-4fcd-8d7a-cb93ebe3d39b tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] [instance: 39fe8666-e4cc-464c-9af9-bd43835bccf6] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:18.596069 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:16:18.608391 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-37312812-ad58-4fcd-8d7a-cb93ebe3d39b tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:18.609226 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-37312812-ad58-4fcd-8d7a-cb93ebe3d39b tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:18.610950 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-37312812-ad58-4fcd-8d7a-cb93ebe3d39b tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:18.612159 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-37312812-ad58-4fcd-8d7a-cb93ebe3d39b tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:18.876509 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-37312812-ad58-4fcd-8d7a-cb93ebe3d39b tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e908d2b09dfc4a139d9c27f52580e15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84fa2f397c54be1b409d8be5ebc8491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:18.890959 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-37312812-ad58-4fcd-8d7a-cb93ebe3d39b tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] 10.222.0.20 "GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6" status: 200 len: 1358 microversion: 2.1 time: 0.304991 Jul 22 11:16:18.891546 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-423c92a2-8193-410f-b7e4-dc6849f3b243 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:18.892988 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-423c92a2-8193-410f-b7e4-dc6849f3b243 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: fbf8cb41-3496-45fe-9392-6add8f6873d0] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:18.901648 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-423c92a2-8193-410f-b7e4-dc6849f3b243 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:18.902486 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-423c92a2-8193-410f-b7e4-dc6849f3b243 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:18.903594 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-423c92a2-8193-410f-b7e4-dc6849f3b243 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:18.904882 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-423c92a2-8193-410f-b7e4-dc6849f3b243 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:18.910639 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 137/286] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:18 2022] GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6 => generated 1358 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:16:19.230779 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-423c92a2-8193-410f-b7e4-dc6849f3b243 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:19.252586 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-423c92a2-8193-410f-b7e4-dc6849f3b243 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0" status: 200 len: 1522 microversion: 2.1 time: 0.366731 Jul 22 11:16:19.262586 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 150/287] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:18 2022] GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0 => generated 1522 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:16:19.417789 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-f8d0a088-39eb-4d3a-848f-892bfb756282 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:19.418521 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-f8d0a088-39eb-4d3a-848f-892bfb756282 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:19.426578 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f8d0a088-39eb-4d3a-848f-892bfb756282 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:19.427036 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f8d0a088-39eb-4d3a-848f-892bfb756282 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:19.427897 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f8d0a088-39eb-4d3a-848f-892bfb756282 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:19.428346 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f8d0a088-39eb-4d3a-848f-892bfb756282 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:19.679218 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-f8d0a088-39eb-4d3a-848f-892bfb756282 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:19.697635 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-f8d0a088-39eb-4d3a-848f-892bfb756282 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:19.701064 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-f8d0a088-39eb-4d3a-848f-892bfb756282 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:19.702822 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-f8d0a088-39eb-4d3a-848f-892bfb756282 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54" status: 200 len: 1408 microversion: 2.20 time: 0.289404 Jul 22 11:16:19.703878 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 138/288] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:16:19 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 => generated 1408 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:16:19.932363 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-a2cca1ef-5dff-45fa-a544-13b8c9715d96 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:19.935320 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-a2cca1ef-5dff-45fa-a544-13b8c9715d96 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] [instance: 39fe8666-e4cc-464c-9af9-bd43835bccf6] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:19.960200 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-a2cca1ef-5dff-45fa-a544-13b8c9715d96 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:19.961000 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-a2cca1ef-5dff-45fa-a544-13b8c9715d96 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:19.962796 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-a2cca1ef-5dff-45fa-a544-13b8c9715d96 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:19.963882 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-a2cca1ef-5dff-45fa-a544-13b8c9715d96 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:20.211950 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-a2cca1ef-5dff-45fa-a544-13b8c9715d96 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e908d2b09dfc4a139d9c27f52580e15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84fa2f397c54be1b409d8be5ebc8491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:20.221729 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-a2cca1ef-5dff-45fa-a544-13b8c9715d96 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] 10.222.0.20 "GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6" status: 200 len: 1358 microversion: 2.1 time: 0.305428 Jul 22 11:16:20.222370 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 151/289] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:19 2022] GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6 => generated 1358 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:16:20.274523 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-69cc2fbd-426a-4056-86ed-78791e5e47ae tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:20.275383 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-69cc2fbd-426a-4056-86ed-78791e5e47ae tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: fbf8cb41-3496-45fe-9392-6add8f6873d0] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:20.286425 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-69cc2fbd-426a-4056-86ed-78791e5e47ae tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:20.287302 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-69cc2fbd-426a-4056-86ed-78791e5e47ae tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:20.288556 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-69cc2fbd-426a-4056-86ed-78791e5e47ae tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:20.296800 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-69cc2fbd-426a-4056-86ed-78791e5e47ae tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:20.512890 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-69cc2fbd-426a-4056-86ed-78791e5e47ae tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:20.523941 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-69cc2fbd-426a-4056-86ed-78791e5e47ae tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0" status: 200 len: 1522 microversion: 2.1 time: 0.254033 Jul 22 11:16:20.525452 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 139/290] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:20 2022] GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0 => generated 1522 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:16:20.635126 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-511146fe-d949-4c4c-94c1-3ffc88f89cb7 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8b678413-f41d-4be8-a739-5359ce8a8f16"}} {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:16:20.638015 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-511146fe-d949-4c4c-94c1-3ffc88f89cb7 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:20.650322 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-511146fe-d949-4c4c-94c1-3ffc88f89cb7 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:20.651367 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-511146fe-d949-4c4c-94c1-3ffc88f89cb7 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:20.652114 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-511146fe-d949-4c4c-94c1-3ffc88f89cb7 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:20.652705 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-511146fe-d949-4c4c-94c1-3ffc88f89cb7 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:20.721307 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-c24794cd-d293-4688-be54-df8db0e9c8cf tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:20.721922 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-c24794cd-d293-4688-be54-df8db0e9c8cf tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:20.728961 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c24794cd-d293-4688-be54-df8db0e9c8cf tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:20.729426 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c24794cd-d293-4688-be54-df8db0e9c8cf tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:20.730588 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c24794cd-d293-4688-be54-df8db0e9c8cf tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:20.731055 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c24794cd-d293-4688-be54-df8db0e9c8cf tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:20.904595 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-c24794cd-d293-4688-be54-df8db0e9c8cf tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:20.914993 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-c24794cd-d293-4688-be54-df8db0e9c8cf tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:20.917347 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-c24794cd-d293-4688-be54-df8db0e9c8cf tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:20.918944 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-c24794cd-d293-4688-be54-df8db0e9c8cf tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54" status: 200 len: 1408 microversion: 2.20 time: 0.201865 Jul 22 11:16:20.920841 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 140/291] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:16:20 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 => generated 1408 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 22 11:16:21.247593 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-2468f968-5dbd-42d7-a009-d1fb554feded tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:21.249062 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-2468f968-5dbd-42d7-a009-d1fb554feded tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] [instance: 39fe8666-e4cc-464c-9af9-bd43835bccf6] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:21.256792 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2468f968-5dbd-42d7-a009-d1fb554feded tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:21.256792 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2468f968-5dbd-42d7-a009-d1fb554feded tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:21.257418 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2468f968-5dbd-42d7-a009-d1fb554feded tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:21.257843 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2468f968-5dbd-42d7-a009-d1fb554feded tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:21.519082 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-2468f968-5dbd-42d7-a009-d1fb554feded tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e908d2b09dfc4a139d9c27f52580e15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84fa2f397c54be1b409d8be5ebc8491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:21.533737 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-2468f968-5dbd-42d7-a009-d1fb554feded tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] 10.222.0.20 "GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6" status: 200 len: 1358 microversion: 2.1 time: 0.289975 Jul 22 11:16:21.534501 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 141/292] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:21 2022] GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6 => generated 1358 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:16:21.560169 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-0d6edf1e-3911-4f38-a646-47355f5143c6 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:21.560802 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-0d6edf1e-3911-4f38-a646-47355f5143c6 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: fbf8cb41-3496-45fe-9392-6add8f6873d0] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:21.567434 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0d6edf1e-3911-4f38-a646-47355f5143c6 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:21.568166 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0d6edf1e-3911-4f38-a646-47355f5143c6 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:21.569130 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0d6edf1e-3911-4f38-a646-47355f5143c6 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:21.569747 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0d6edf1e-3911-4f38-a646-47355f5143c6 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:21.742802 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-0d6edf1e-3911-4f38-a646-47355f5143c6 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:21.750516 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-0d6edf1e-3911-4f38-a646-47355f5143c6 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0" status: 200 len: 1522 microversion: 2.1 time: 0.204190 Jul 22 11:16:21.751099 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 142/293] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:21 2022] GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0 => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:16:21.940449 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-29283280-d34e-468f-bea9-0b75ee0afcf6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:21.941077 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-29283280-d34e-468f-bea9-0b75ee0afcf6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:21.953226 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-29283280-d34e-468f-bea9-0b75ee0afcf6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:21.954024 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-29283280-d34e-468f-bea9-0b75ee0afcf6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:21.955906 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-29283280-d34e-468f-bea9-0b75ee0afcf6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:21.957027 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-29283280-d34e-468f-bea9-0b75ee0afcf6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:22.206144 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-29283280-d34e-468f-bea9-0b75ee0afcf6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:22.224203 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-29283280-d34e-468f-bea9-0b75ee0afcf6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:22.226935 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-29283280-d34e-468f-bea9-0b75ee0afcf6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:22.228960 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-29283280-d34e-468f-bea9-0b75ee0afcf6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54" status: 200 len: 1408 microversion: 2.20 time: 0.293088 Jul 22 11:16:22.229972 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 143/294] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:16:21 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 => generated 1408 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 22 11:16:22.555197 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-6f9e84af-40d7-4842-9e0e-282d0fde47b7 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:22.557288 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-6f9e84af-40d7-4842-9e0e-282d0fde47b7 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] [instance: 39fe8666-e4cc-464c-9af9-bd43835bccf6] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:22.565479 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6f9e84af-40d7-4842-9e0e-282d0fde47b7 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:22.565892 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6f9e84af-40d7-4842-9e0e-282d0fde47b7 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:22.566632 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6f9e84af-40d7-4842-9e0e-282d0fde47b7 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:22.567228 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6f9e84af-40d7-4842-9e0e-282d0fde47b7 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:22.761448 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-6f9e84af-40d7-4842-9e0e-282d0fde47b7 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e908d2b09dfc4a139d9c27f52580e15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84fa2f397c54be1b409d8be5ebc8491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:22.774491 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-6f9e84af-40d7-4842-9e0e-282d0fde47b7 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] 10.222.0.20 "GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6" status: 200 len: 1358 microversion: 2.1 time: 0.226038 Jul 22 11:16:22.775009 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 144/295] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:22 2022] GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6 => generated 1358 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:16:22.780335 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-7d5434e3-dad5-47be-a2c6-c80d4ec5cf99 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:22.780943 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-7d5434e3-dad5-47be-a2c6-c80d4ec5cf99 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: fbf8cb41-3496-45fe-9392-6add8f6873d0] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:22.787551 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7d5434e3-dad5-47be-a2c6-c80d4ec5cf99 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:22.787993 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7d5434e3-dad5-47be-a2c6-c80d4ec5cf99 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:22.788775 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7d5434e3-dad5-47be-a2c6-c80d4ec5cf99 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:22.789206 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7d5434e3-dad5-47be-a2c6-c80d4ec5cf99 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:22.975880 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-7d5434e3-dad5-47be-a2c6-c80d4ec5cf99 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:22.985466 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-7d5434e3-dad5-47be-a2c6-c80d4ec5cf99 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0" status: 200 len: 1522 microversion: 2.1 time: 0.209357 Jul 22 11:16:22.986173 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 145/296] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:22 2022] GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0 => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:16:23.250064 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-c7299379-8f7f-4593-9edc-949d54defc99 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:23.251087 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-c7299379-8f7f-4593-9edc-949d54defc99 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:23.259024 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c7299379-8f7f-4593-9edc-949d54defc99 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:23.259589 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c7299379-8f7f-4593-9edc-949d54defc99 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:23.260373 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c7299379-8f7f-4593-9edc-949d54defc99 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:23.260806 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c7299379-8f7f-4593-9edc-949d54defc99 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:23.422820 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-c7299379-8f7f-4593-9edc-949d54defc99 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:23.431436 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-c7299379-8f7f-4593-9edc-949d54defc99 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:23.432854 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-c7299379-8f7f-4593-9edc-949d54defc99 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:23.433975 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-c7299379-8f7f-4593-9edc-949d54defc99 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54" status: 200 len: 1408 microversion: 2.20 time: 0.188559 Jul 22 11:16:23.434547 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 146/297] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:16:23 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 => generated 1408 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:16:23.793823 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-1883a481-ce43-4332-acb4-0d3dcb468762 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:23.794516 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-1883a481-ce43-4332-acb4-0d3dcb468762 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] [instance: 39fe8666-e4cc-464c-9af9-bd43835bccf6] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:23.801220 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1883a481-ce43-4332-acb4-0d3dcb468762 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:23.801661 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1883a481-ce43-4332-acb4-0d3dcb468762 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:23.802430 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1883a481-ce43-4332-acb4-0d3dcb468762 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:23.802867 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1883a481-ce43-4332-acb4-0d3dcb468762 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:23.985133 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-1883a481-ce43-4332-acb4-0d3dcb468762 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e908d2b09dfc4a139d9c27f52580e15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84fa2f397c54be1b409d8be5ebc8491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:23.989874 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=100 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:16:23.997556 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-1883a481-ce43-4332-acb4-0d3dcb468762 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] 10.222.0.20 "GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6" status: 200 len: 1358 microversion: 2.1 time: 0.207258 Jul 22 11:16:23.999314 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 147/298] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:23 2022] GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6 => generated 1358 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:16:24.010252 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-77e9f6ef-f29e-4541-92a3-e8f35cb43016 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:24.011284 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-77e9f6ef-f29e-4541-92a3-e8f35cb43016 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: fbf8cb41-3496-45fe-9392-6add8f6873d0] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:24.024182 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-77e9f6ef-f29e-4541-92a3-e8f35cb43016 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:24.026428 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-77e9f6ef-f29e-4541-92a3-e8f35cb43016 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:24.030216 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-77e9f6ef-f29e-4541-92a3-e8f35cb43016 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:24.031208 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-77e9f6ef-f29e-4541-92a3-e8f35cb43016 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:24.203363 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-77e9f6ef-f29e-4541-92a3-e8f35cb43016 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:24.211847 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-77e9f6ef-f29e-4541-92a3-e8f35cb43016 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0" status: 200 len: 1522 microversion: 2.1 time: 0.205299 Jul 22 11:16:24.213148 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 148/299] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:24 2022] GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0 => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:16:24.458291 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-a70aa067-624e-4608-8b3c-905707120de6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:24.459828 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-a70aa067-624e-4608-8b3c-905707120de6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:24.468452 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a70aa067-624e-4608-8b3c-905707120de6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:24.468928 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a70aa067-624e-4608-8b3c-905707120de6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:24.469696 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a70aa067-624e-4608-8b3c-905707120de6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:24.470132 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a70aa067-624e-4608-8b3c-905707120de6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:24.628329 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-a70aa067-624e-4608-8b3c-905707120de6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:24.636981 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-a70aa067-624e-4608-8b3c-905707120de6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:24.638528 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-a70aa067-624e-4608-8b3c-905707120de6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:24.639664 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-a70aa067-624e-4608-8b3c-905707120de6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54" status: 200 len: 1408 microversion: 2.20 time: 0.190636 Jul 22 11:16:24.640222 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 149/300] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:16:24 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 => generated 1408 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 22 11:16:25.016180 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-4849afce-06b9-474e-970c-30d1229898da tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:25.016852 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-4849afce-06b9-474e-970c-30d1229898da tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] [instance: 39fe8666-e4cc-464c-9af9-bd43835bccf6] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:25.023766 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4849afce-06b9-474e-970c-30d1229898da tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:25.024207 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4849afce-06b9-474e-970c-30d1229898da tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:25.024973 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4849afce-06b9-474e-970c-30d1229898da tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:25.025403 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4849afce-06b9-474e-970c-30d1229898da tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:25.164557 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-4849afce-06b9-474e-970c-30d1229898da tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e908d2b09dfc4a139d9c27f52580e15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84fa2f397c54be1b409d8be5ebc8491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:25.172377 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-4849afce-06b9-474e-970c-30d1229898da tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] 10.222.0.20 "GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6" status: 200 len: 1358 microversion: 2.1 time: 0.160720 Jul 22 11:16:25.172968 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 150/301] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:25 2022] GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:16:25.233957 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-0831a1d9-44ca-49a7-9454-1a143d221421 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:25.234559 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-0831a1d9-44ca-49a7-9454-1a143d221421 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: fbf8cb41-3496-45fe-9392-6add8f6873d0] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:25.240960 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0831a1d9-44ca-49a7-9454-1a143d221421 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:25.241410 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0831a1d9-44ca-49a7-9454-1a143d221421 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:25.242189 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0831a1d9-44ca-49a7-9454-1a143d221421 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:25.242624 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0831a1d9-44ca-49a7-9454-1a143d221421 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:25.378284 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-0831a1d9-44ca-49a7-9454-1a143d221421 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:25.386560 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-0831a1d9-44ca-49a7-9454-1a143d221421 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0" status: 200 len: 1522 microversion: 2.1 time: 0.156355 Jul 22 11:16:25.387244 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 151/302] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:25 2022] GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:16:25.665441 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-2d20f776-dc5b-468a-a7ac-fdd0295f501f tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:25.666664 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-2d20f776-dc5b-468a-a7ac-fdd0295f501f tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:25.673502 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2d20f776-dc5b-468a-a7ac-fdd0295f501f tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:25.673948 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2d20f776-dc5b-468a-a7ac-fdd0295f501f tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:25.674726 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2d20f776-dc5b-468a-a7ac-fdd0295f501f tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:25.675157 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2d20f776-dc5b-468a-a7ac-fdd0295f501f tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:25.840956 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-2d20f776-dc5b-468a-a7ac-fdd0295f501f tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:25.853454 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-2d20f776-dc5b-468a-a7ac-fdd0295f501f tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:25.854920 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-2d20f776-dc5b-468a-a7ac-fdd0295f501f tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:25.856080 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-2d20f776-dc5b-468a-a7ac-fdd0295f501f tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54" status: 200 len: 1408 microversion: 2.20 time: 0.195620 Jul 22 11:16:25.856729 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 152/303] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:16:25 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 => generated 1408 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 22 11:16:26.192066 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-84783745-94b7-4f91-8f07-8acd6f9ac8f2 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:26.193468 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-84783745-94b7-4f91-8f07-8acd6f9ac8f2 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] [instance: 39fe8666-e4cc-464c-9af9-bd43835bccf6] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:26.202687 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-84783745-94b7-4f91-8f07-8acd6f9ac8f2 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:26.203373 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-84783745-94b7-4f91-8f07-8acd6f9ac8f2 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:26.204887 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-84783745-94b7-4f91-8f07-8acd6f9ac8f2 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:26.205707 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-84783745-94b7-4f91-8f07-8acd6f9ac8f2 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:26.433349 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-84783745-94b7-4f91-8f07-8acd6f9ac8f2 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e908d2b09dfc4a139d9c27f52580e15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84fa2f397c54be1b409d8be5ebc8491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:26.445703 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-84783745-94b7-4f91-8f07-8acd6f9ac8f2 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] 10.222.0.20 "GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6" status: 200 len: 1358 microversion: 2.1 time: 0.258583 Jul 22 11:16:26.446724 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 153/304] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:26 2022] GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6 => generated 1358 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:16:26.452740 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-197c3f45-0715-4263-a8c6-72a41b47f30b tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:26.453860 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-197c3f45-0715-4263-a8c6-72a41b47f30b tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: fbf8cb41-3496-45fe-9392-6add8f6873d0] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:26.462469 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-197c3f45-0715-4263-a8c6-72a41b47f30b tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:26.463186 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-197c3f45-0715-4263-a8c6-72a41b47f30b tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:26.473967 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-197c3f45-0715-4263-a8c6-72a41b47f30b tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:26.475595 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-197c3f45-0715-4263-a8c6-72a41b47f30b tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:26.856601 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-197c3f45-0715-4263-a8c6-72a41b47f30b tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:26.874442 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-197c3f45-0715-4263-a8c6-72a41b47f30b tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0" status: 200 len: 1522 microversion: 2.1 time: 0.425796 Jul 22 11:16:26.875480 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 154/305] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:26 2022] GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0 => generated 1522 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:16:26.902497 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-4e088351-6bc7-4943-a215-be9f71cf7f02 req-63225ff7-82f5-405d-be8f-ef94465158ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39fe8666-e4cc-464c-9af9-bd43835bccf6", "tag": "2dfea6d8-ff88-4cd2-885a-008177cdfd33"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:16:26.913961 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-4e088351-6bc7-4943-a215-be9f71cf7f02 req-63225ff7-82f5-405d-be8f-ef94465158ca service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:26.914876 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-4e088351-6bc7-4943-a215-be9f71cf7f02 req-63225ff7-82f5-405d-be8f-ef94465158ca service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:26.932974 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-4e088351-6bc7-4943-a215-be9f71cf7f02 req-63225ff7-82f5-405d-be8f-ef94465158ca service nova] Creating event network-changed:2dfea6d8-ff88-4cd2-885a-008177cdfd33 for instance 39fe8666-e4cc-464c-9af9-bd43835bccf6 on hv-cinder-84890 Jul 22 11:16:26.942701 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-4e088351-6bc7-4943-a215-be9f71cf7f02 req-63225ff7-82f5-405d-be8f-ef94465158ca service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047310 Jul 22 11:16:26.944427 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 155/306] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:16:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:16:26.955731 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-2cac994d-bf63-4d1d-a4d8-36c8af27a3e8 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:26.957129 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-2cac994d-bf63-4d1d-a4d8-36c8af27a3e8 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:26.968594 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2cac994d-bf63-4d1d-a4d8-36c8af27a3e8 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:26.969694 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2cac994d-bf63-4d1d-a4d8-36c8af27a3e8 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:26.972189 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2cac994d-bf63-4d1d-a4d8-36c8af27a3e8 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:26.973139 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2cac994d-bf63-4d1d-a4d8-36c8af27a3e8 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:27.141213 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-511146fe-d949-4c4c-94c1-3ffc88f89cb7 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "POST /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 6.513977 Jul 22 11:16:27.143864 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 152/307] 10.222.0.20 () {60 vars in 1322 bytes} [Fri Jul 22 11:16:20 2022] POST /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1/os-volume_attachments => generated 194 bytes in 6518 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:16:27.197406 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-2cac994d-bf63-4d1d-a4d8-36c8af27a3e8 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:27.214492 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-2cac994d-bf63-4d1d-a4d8-36c8af27a3e8 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:27.218231 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-2cac994d-bf63-4d1d-a4d8-36c8af27a3e8 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:27.220300 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-2cac994d-bf63-4d1d-a4d8-36c8af27a3e8 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54" status: 200 len: 1408 microversion: 2.20 time: 0.272373 Jul 22 11:16:27.221666 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 156/308] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:16:26 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 => generated 1408 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:16:27.467455 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-a12312e4-df98-4a6d-88e9-70cccbff6aed tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:27.468061 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-a12312e4-df98-4a6d-88e9-70cccbff6aed tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] [instance: 39fe8666-e4cc-464c-9af9-bd43835bccf6] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:27.475629 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-a12312e4-df98-4a6d-88e9-70cccbff6aed tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:27.476221 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-a12312e4-df98-4a6d-88e9-70cccbff6aed tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:27.477254 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-a12312e4-df98-4a6d-88e9-70cccbff6aed tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:27.477792 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-a12312e4-df98-4a6d-88e9-70cccbff6aed tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:27.640279 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-a12312e4-df98-4a6d-88e9-70cccbff6aed tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e908d2b09dfc4a139d9c27f52580e15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84fa2f397c54be1b409d8be5ebc8491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:27.651084 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-a12312e4-df98-4a6d-88e9-70cccbff6aed tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] 10.222.0.20 "GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6" status: 200 len: 1358 microversion: 2.1 time: 0.188279 Jul 22 11:16:27.651887 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 153/309] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:27 2022] GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6 => generated 1358 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:16:27.908780 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-7f24e50a-c114-4079-a083-dcc0e6138cc2 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:27.909386 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-7f24e50a-c114-4079-a083-dcc0e6138cc2 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: fbf8cb41-3496-45fe-9392-6add8f6873d0] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:27.915725 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7f24e50a-c114-4079-a083-dcc0e6138cc2 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:27.916170 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7f24e50a-c114-4079-a083-dcc0e6138cc2 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:27.916946 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7f24e50a-c114-4079-a083-dcc0e6138cc2 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:27.917380 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7f24e50a-c114-4079-a083-dcc0e6138cc2 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:28.061787 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-7f24e50a-c114-4079-a083-dcc0e6138cc2 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:28.069692 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-7f24e50a-c114-4079-a083-dcc0e6138cc2 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0" status: 200 len: 1522 microversion: 2.1 time: 0.164784 Jul 22 11:16:28.070309 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 157/310] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:27 2022] GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:16:28.240858 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-6fdbedd8-0e70-4024-b835-77644f4a0e81 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:28.241460 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-6fdbedd8-0e70-4024-b835-77644f4a0e81 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:28.248282 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-6fdbedd8-0e70-4024-b835-77644f4a0e81 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:28.248912 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-6fdbedd8-0e70-4024-b835-77644f4a0e81 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:28.249786 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-6fdbedd8-0e70-4024-b835-77644f4a0e81 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:28.250446 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-6fdbedd8-0e70-4024-b835-77644f4a0e81 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:28.414907 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-6fdbedd8-0e70-4024-b835-77644f4a0e81 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:28.423907 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-6fdbedd8-0e70-4024-b835-77644f4a0e81 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:28.425414 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-6fdbedd8-0e70-4024-b835-77644f4a0e81 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:28.426647 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-6fdbedd8-0e70-4024-b835-77644f4a0e81 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54" status: 200 len: 1408 microversion: 2.20 time: 0.189899 Jul 22 11:16:28.427192 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 154/311] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:16:28 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 => generated 1408 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:16:28.675759 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-90726b99-4f05-4318-a1f1-bb3ee0be4ab3 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:28.676365 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-90726b99-4f05-4318-a1f1-bb3ee0be4ab3 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] [instance: 39fe8666-e4cc-464c-9af9-bd43835bccf6] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:28.682906 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-90726b99-4f05-4318-a1f1-bb3ee0be4ab3 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:28.683640 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-90726b99-4f05-4318-a1f1-bb3ee0be4ab3 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:28.684430 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-90726b99-4f05-4318-a1f1-bb3ee0be4ab3 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:28.685464 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-90726b99-4f05-4318-a1f1-bb3ee0be4ab3 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:28.819497 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-90726b99-4f05-4318-a1f1-bb3ee0be4ab3 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e908d2b09dfc4a139d9c27f52580e15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84fa2f397c54be1b409d8be5ebc8491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:28.827099 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-90726b99-4f05-4318-a1f1-bb3ee0be4ab3 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] 10.222.0.20 "GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6" status: 200 len: 1358 microversion: 2.1 time: 0.155190 Jul 22 11:16:28.827707 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 158/312] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:28 2022] GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:16:29.087423 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-ea32917e-2160-49d7-be53-e38d03e64506 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:29.088371 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-ea32917e-2160-49d7-be53-e38d03e64506 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: fbf8cb41-3496-45fe-9392-6add8f6873d0] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:29.090778 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG dbcounter [-] [117884] Writing DB stats nova_api:SELECT=56 {{(pid=117884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:16:29.096834 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-ea32917e-2160-49d7-be53-e38d03e64506 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:29.097275 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-ea32917e-2160-49d7-be53-e38d03e64506 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:29.098047 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-ea32917e-2160-49d7-be53-e38d03e64506 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:29.098476 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-ea32917e-2160-49d7-be53-e38d03e64506 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:29.115888 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG dbcounter [-] [117884] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:16:29.236605 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-ea32917e-2160-49d7-be53-e38d03e64506 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:29.244650 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-ea32917e-2160-49d7-be53-e38d03e64506 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0" status: 200 len: 1522 microversion: 2.1 time: 0.161033 Jul 22 11:16:29.247495 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 155/313] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:29 2022] GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:16:29.444329 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-03944553-7012-46e5-bbe8-1c816398b385 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:29.444940 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-03944553-7012-46e5-bbe8-1c816398b385 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:29.451975 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-03944553-7012-46e5-bbe8-1c816398b385 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:29.452424 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-03944553-7012-46e5-bbe8-1c816398b385 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:29.453210 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-03944553-7012-46e5-bbe8-1c816398b385 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:29.453644 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-03944553-7012-46e5-bbe8-1c816398b385 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:29.599990 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-03944553-7012-46e5-bbe8-1c816398b385 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:29.608707 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-03944553-7012-46e5-bbe8-1c816398b385 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:29.610223 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-03944553-7012-46e5-bbe8-1c816398b385 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:29.611533 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-03944553-7012-46e5-bbe8-1c816398b385 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54" status: 200 len: 1408 microversion: 2.20 time: 0.171124 Jul 22 11:16:29.612095 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 159/314] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:16:29 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 => generated 1408 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:16:29.843934 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-ffb43cc8-590a-4279-bdc6-f38f228377cf tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:29.844544 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-ffb43cc8-590a-4279-bdc6-f38f228377cf tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] [instance: 39fe8666-e4cc-464c-9af9-bd43835bccf6] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:29.850752 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-ffb43cc8-590a-4279-bdc6-f38f228377cf tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:29.851204 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-ffb43cc8-590a-4279-bdc6-f38f228377cf tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:29.852009 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-ffb43cc8-590a-4279-bdc6-f38f228377cf tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:29.852447 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-ffb43cc8-590a-4279-bdc6-f38f228377cf tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:29.993228 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-ffb43cc8-590a-4279-bdc6-f38f228377cf tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e908d2b09dfc4a139d9c27f52580e15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84fa2f397c54be1b409d8be5ebc8491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:30.002117 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-ffb43cc8-590a-4279-bdc6-f38f228377cf tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] 10.222.0.20 "GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6" status: 200 len: 1358 microversion: 2.1 time: 0.161962 Jul 22 11:16:30.002706 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 156/315] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:29 2022] GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:16:30.261789 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-7bb314fe-8ca6-4431-80d6-d0e8e5d6dcf0 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:30.262323 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-7bb314fe-8ca6-4431-80d6-d0e8e5d6dcf0 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: fbf8cb41-3496-45fe-9392-6add8f6873d0] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:30.269951 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7bb314fe-8ca6-4431-80d6-d0e8e5d6dcf0 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:30.270698 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7bb314fe-8ca6-4431-80d6-d0e8e5d6dcf0 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:30.271531 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7bb314fe-8ca6-4431-80d6-d0e8e5d6dcf0 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:30.271969 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7bb314fe-8ca6-4431-80d6-d0e8e5d6dcf0 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:30.411346 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-7bb314fe-8ca6-4431-80d6-d0e8e5d6dcf0 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:30.418984 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-7bb314fe-8ca6-4431-80d6-d0e8e5d6dcf0 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0" status: 200 len: 1522 microversion: 2.1 time: 0.161099 Jul 22 11:16:30.420370 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 160/316] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:30 2022] GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:16:30.630650 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-3f278e70-2c09-488b-95f9-f62b07871edd tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:30.631320 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-3f278e70-2c09-488b-95f9-f62b07871edd tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:30.638117 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-3f278e70-2c09-488b-95f9-f62b07871edd tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:30.638719 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-3f278e70-2c09-488b-95f9-f62b07871edd tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:30.639529 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-3f278e70-2c09-488b-95f9-f62b07871edd tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:30.639961 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-3f278e70-2c09-488b-95f9-f62b07871edd tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:30.795734 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-3f278e70-2c09-488b-95f9-f62b07871edd tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:30.804288 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-3f278e70-2c09-488b-95f9-f62b07871edd tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:30.805807 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-3f278e70-2c09-488b-95f9-f62b07871edd tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:30.806954 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-3f278e70-2c09-488b-95f9-f62b07871edd tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54" status: 200 len: 1408 microversion: 2.20 time: 0.180943 Jul 22 11:16:30.807561 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 157/317] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:16:30 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 => generated 1408 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:16:31.021578 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-d7e7bf06-2f3a-4108-9074-27c885c2ef01 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:31.022633 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-d7e7bf06-2f3a-4108-9074-27c885c2ef01 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] [instance: 39fe8666-e4cc-464c-9af9-bd43835bccf6] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:31.033992 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d7e7bf06-2f3a-4108-9074-27c885c2ef01 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:31.034819 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d7e7bf06-2f3a-4108-9074-27c885c2ef01 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:31.037242 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d7e7bf06-2f3a-4108-9074-27c885c2ef01 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:31.038571 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d7e7bf06-2f3a-4108-9074-27c885c2ef01 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:31.257514 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-d7e7bf06-2f3a-4108-9074-27c885c2ef01 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e908d2b09dfc4a139d9c27f52580e15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84fa2f397c54be1b409d8be5ebc8491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:31.268761 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-d7e7bf06-2f3a-4108-9074-27c885c2ef01 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] 10.222.0.20 "GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6" status: 200 len: 1358 microversion: 2.1 time: 0.253354 Jul 22 11:16:31.269738 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 161/318] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:31 2022] GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6 => generated 1358 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:16:31.444420 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-24bbb156-bec7-46b9-9996-7dd52bed5fd3 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:31.446159 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-24bbb156-bec7-46b9-9996-7dd52bed5fd3 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: fbf8cb41-3496-45fe-9392-6add8f6873d0] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:31.458653 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-24bbb156-bec7-46b9-9996-7dd52bed5fd3 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:31.459480 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-24bbb156-bec7-46b9-9996-7dd52bed5fd3 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:31.461269 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-24bbb156-bec7-46b9-9996-7dd52bed5fd3 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:31.462062 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-24bbb156-bec7-46b9-9996-7dd52bed5fd3 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:31.543405 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-47ed2d59-f503-482c-8c07-b0fe660b59c6 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Action: 'create', calling method: .version_select at 0x7f84466b6a60>, body: {"keypair": {"name": "tempest-keypair-977198902", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBZGDoFt9ZxToKISx3geL3RfxDGouU4U1wbhR9wM2G57VGpd0tjSXrc/ryaI8efNbdAEhKn/TTZnLYON4mT5lEY/yV+ozQ3d+pASwHe/GBcjUm72H030XRPrV3X6GJiHyw=="}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:16:31.573636 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-47ed2d59-f503-482c-8c07-b0fe660b59c6 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Getting quotas for project 28836b7cb9c646aaaa1bb1c1fae68128. Resources: {'key_pairs'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 22 11:16:31.581984 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-47ed2d59-f503-482c-8c07-b0fe660b59c6 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Getting quotas for user 691877dce1024aeda61629073d74602b and project 28836b7cb9c646aaaa1bb1c1fae68128. Resources: {'key_pairs'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 22 11:16:31.641351 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-47ed2d59-f503-482c-8c07-b0fe660b59c6 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.113013 Jul 22 11:16:31.642953 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 162/319] 10.222.0.20 () {60 vars in 1158 bytes} [Fri Jul 22 11:16:31 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:16:31.738876 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-24bbb156-bec7-46b9-9996-7dd52bed5fd3 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:31.760458 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-24bbb156-bec7-46b9-9996-7dd52bed5fd3 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0" status: 200 len: 1522 microversion: 2.1 time: 0.320041 Jul 22 11:16:31.760458 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 158/320] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:31 2022] GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0 => generated 1522 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:16:31.829244 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-94047a45-2c61-4e3d-82cd-c937ff52a7db tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:31.830361 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-94047a45-2c61-4e3d-82cd-c937ff52a7db tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:31.838234 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-94047a45-2c61-4e3d-82cd-c937ff52a7db tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:31.838672 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-94047a45-2c61-4e3d-82cd-c937ff52a7db tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:31.839493 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-94047a45-2c61-4e3d-82cd-c937ff52a7db tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:31.839929 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-94047a45-2c61-4e3d-82cd-c937ff52a7db tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:32.087858 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-94047a45-2c61-4e3d-82cd-c937ff52a7db tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:32.097792 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-94047a45-2c61-4e3d-82cd-c937ff52a7db tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:32.099630 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-94047a45-2c61-4e3d-82cd-c937ff52a7db tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:32.101688 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-94047a45-2c61-4e3d-82cd-c937ff52a7db tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54" status: 200 len: 1408 microversion: 2.20 time: 0.279338 Jul 22 11:16:32.102913 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 163/321] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:16:31 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 => generated 1408 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:16:32.292482 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-545452c2-cac8-499c-9ba5-99431ad3ba7a tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:32.293134 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-545452c2-cac8-499c-9ba5-99431ad3ba7a tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] [instance: 39fe8666-e4cc-464c-9af9-bd43835bccf6] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:32.302319 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-545452c2-cac8-499c-9ba5-99431ad3ba7a tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:32.302771 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-545452c2-cac8-499c-9ba5-99431ad3ba7a tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:32.303916 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-545452c2-cac8-499c-9ba5-99431ad3ba7a tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:32.304378 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-545452c2-cac8-499c-9ba5-99431ad3ba7a tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:32.510387 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-545452c2-cac8-499c-9ba5-99431ad3ba7a tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e908d2b09dfc4a139d9c27f52580e15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84fa2f397c54be1b409d8be5ebc8491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:32.524543 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-545452c2-cac8-499c-9ba5-99431ad3ba7a tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] 10.222.0.20 "GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6" status: 200 len: 1358 microversion: 2.1 time: 0.237181 Jul 22 11:16:32.525557 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 159/322] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:32 2022] GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6 => generated 1358 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:16:32.782218 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-e36e1a60-6c70-49fe-b5c6-b2e5b0be846e tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:32.784644 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-e36e1a60-6c70-49fe-b5c6-b2e5b0be846e tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: fbf8cb41-3496-45fe-9392-6add8f6873d0] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:32.798006 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e36e1a60-6c70-49fe-b5c6-b2e5b0be846e tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:32.798900 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e36e1a60-6c70-49fe-b5c6-b2e5b0be846e tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:32.801017 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e36e1a60-6c70-49fe-b5c6-b2e5b0be846e tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:32.802014 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e36e1a60-6c70-49fe-b5c6-b2e5b0be846e tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:33.128807 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-ef5ccde8-f7e9-4fb6-91af-17ef30dba74c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:33.129718 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-ef5ccde8-f7e9-4fb6-91af-17ef30dba74c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:33.140401 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-ef5ccde8-f7e9-4fb6-91af-17ef30dba74c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:33.144210 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-ef5ccde8-f7e9-4fb6-91af-17ef30dba74c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:33.146566 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-ef5ccde8-f7e9-4fb6-91af-17ef30dba74c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:33.147734 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-ef5ccde8-f7e9-4fb6-91af-17ef30dba74c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:33.149006 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-e36e1a60-6c70-49fe-b5c6-b2e5b0be846e tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:33.157940 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-e36e1a60-6c70-49fe-b5c6-b2e5b0be846e tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0" status: 200 len: 1522 microversion: 2.1 time: 0.382288 Jul 22 11:16:33.158859 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 164/323] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:32 2022] GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0 => generated 1522 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:16:33.409514 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-ef5ccde8-f7e9-4fb6-91af-17ef30dba74c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:33.424433 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-ef5ccde8-f7e9-4fb6-91af-17ef30dba74c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:33.427001 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-ef5ccde8-f7e9-4fb6-91af-17ef30dba74c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:33.428893 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-ef5ccde8-f7e9-4fb6-91af-17ef30dba74c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54" status: 200 len: 1600 microversion: 2.20 time: 0.306512 Jul 22 11:16:33.430218 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 160/324] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:16:33 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 => generated 1600 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:16:33.459713 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-e89fcc3f-2550-419a-9397-baff3bb5c371 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:33.460590 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-e89fcc3f-2550-419a-9397-baff3bb5c371 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:33.472226 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e89fcc3f-2550-419a-9397-baff3bb5c371 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:33.473056 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e89fcc3f-2550-419a-9397-baff3bb5c371 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:33.473871 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e89fcc3f-2550-419a-9397-baff3bb5c371 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:33.474291 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e89fcc3f-2550-419a-9397-baff3bb5c371 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:33.550352 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-e7a5c5c4-6887-4653-88b1-2beea77ba23c tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:33.551227 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-e7a5c5c4-6887-4653-88b1-2beea77ba23c tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] [instance: 39fe8666-e4cc-464c-9af9-bd43835bccf6] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:33.559729 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-e7a5c5c4-6887-4653-88b1-2beea77ba23c tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:33.560319 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-e7a5c5c4-6887-4653-88b1-2beea77ba23c tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:33.561485 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-e7a5c5c4-6887-4653-88b1-2beea77ba23c tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:33.562072 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-e7a5c5c4-6887-4653-88b1-2beea77ba23c tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:33.620320 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-e89fcc3f-2550-419a-9397-baff3bb5c371 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.167263 Jul 22 11:16:33.622601 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 165/325] 10.222.0.20 () {60 vars in 1315 bytes} [Fri Jul 22 11:16:33 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54/os-interface => generated 284 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 22 11:16:33.915009 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-6aa80e63-f3ff-4aba-9618-ea3ee1b5672d tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1025707742", "imageRef": "1a6c3cb4-9f56-44c6-aa68-01000df27209", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "32cd3386-64da-4740-85d1-ffc0b29096eb"}], "security_groups": [{"name": "tempest-securitygroup--2011330605"}], "key_name": "tempest-keypair-977198902", "user_data": "}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:16:34.021369 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-e7a5c5c4-6887-4653-88b1-2beea77ba23c tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e908d2b09dfc4a139d9c27f52580e15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84fa2f397c54be1b409d8be5ebc8491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:34.034840 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-e7a5c5c4-6887-4653-88b1-2beea77ba23c tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] 10.222.0.20 "GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6" status: 200 len: 1358 microversion: 2.1 time: 0.488511 Jul 22 11:16:34.035848 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 161/326] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:33 2022] GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6 => generated 1358 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:16:34.075000 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.network.neutron [None req-6aa80e63-f3ff-4aba-9618-ea3ee1b5672d tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] validate_networks() for [('32cd3386-64da-4740-85d1-ffc0b29096eb', None, None, None, None, None)] {{(pid=117885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 22 11:16:34.180849 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-525f2f84-7da0-4ff7-9f64-ff1ae3d13aac tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:34.182273 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-525f2f84-7da0-4ff7-9f64-ff1ae3d13aac tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: fbf8cb41-3496-45fe-9392-6add8f6873d0] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:34.189607 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-525f2f84-7da0-4ff7-9f64-ff1ae3d13aac tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:34.190051 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-525f2f84-7da0-4ff7-9f64-ff1ae3d13aac tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:34.191159 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-525f2f84-7da0-4ff7-9f64-ff1ae3d13aac tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:34.191671 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-525f2f84-7da0-4ff7-9f64-ff1ae3d13aac tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:34.630672 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-6aa80e63-f3ff-4aba-9618-ea3ee1b5672d tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Flavor limits 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 22 11:16:34.631088 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-6aa80e63-f3ff-4aba-9618-ea3ee1b5672d tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Image limits 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 22 11:16:34.631605 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-6aa80e63-f3ff-4aba-9618-ea3ee1b5672d tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Flavor pref 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 22 11:16:34.632084 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-6aa80e63-f3ff-4aba-9618-ea3ee1b5672d tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Image pref 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 22 11:16:34.632479 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-6aa80e63-f3ff-4aba-9618-ea3ee1b5672d tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 22 11:16:34.646755 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6aa80e63-f3ff-4aba-9618-ea3ee1b5672d tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:34.648126 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6aa80e63-f3ff-4aba-9618-ea3ee1b5672d tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:34.649469 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6aa80e63-f3ff-4aba-9618-ea3ee1b5672d tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:34.650265 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6aa80e63-f3ff-4aba-9618-ea3ee1b5672d tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:34.677455 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-6aa80e63-f3ff-4aba-9618-ea3ee1b5672d tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Getting quotas for project 28836b7cb9c646aaaa1bb1c1fae68128. Resources: {'instances', 'cores', 'ram'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 22 11:16:34.683786 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-6aa80e63-f3ff-4aba-9618-ea3ee1b5672d tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Getting quotas for user 691877dce1024aeda61629073d74602b and project 28836b7cb9c646aaaa1bb1c1fae68128. Resources: {'instances', 'cores', 'ram'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 22 11:16:34.704237 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-6aa80e63-f3ff-4aba-9618-ea3ee1b5672d tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Going to run 1 instances... {{(pid=117885) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 22 11:16:34.708330 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-6aa80e63-f3ff-4aba-9618-ea3ee1b5672d tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: d50614d9-5b91-43b0-952b-d5ecc987e85a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1a6c3cb4-9f56-44c6-aa68-01000df27209',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 22 11:16:34.816363 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-6aa80e63-f3ff-4aba-9618-ea3ee1b5672d tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.905998 Jul 22 11:16:34.819616 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 166/327] 10.222.0.20 () {60 vars in 1146 bytes} [Fri Jul 22 11:16:33 2022] POST /compute/v2.1/servers => generated 402 bytes in 910 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 22 11:16:34.837617 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-7ca4ca30-6109-40cb-945d-c7c7b5f6a1fe tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:34.842310 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-7ca4ca30-6109-40cb-945d-c7c7b5f6a1fe tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: d50614d9-5b91-43b0-952b-d5ecc987e85a] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:34.953516 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-7ca4ca30-6109-40cb-945d-c7c7b5f6a1fe tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:34.961836 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-7ca4ca30-6109-40cb-945d-c7c7b5f6a1fe tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/d50614d9-5b91-43b0-952b-d5ecc987e85a" status: 200 len: 1241 microversion: 2.1 time: 0.132518 Jul 22 11:16:34.962426 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 167/328] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:34 2022] GET /compute/v2.1/servers/d50614d9-5b91-43b0-952b-d5ecc987e85a => generated 1241 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:16:35.064631 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-8eb99e45-34cb-4a04-b528-63d437bb08b1 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:35.065708 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-8eb99e45-34cb-4a04-b528-63d437bb08b1 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] [instance: 39fe8666-e4cc-464c-9af9-bd43835bccf6] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:35.075029 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8eb99e45-34cb-4a04-b528-63d437bb08b1 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:35.075872 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8eb99e45-34cb-4a04-b528-63d437bb08b1 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:35.078050 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8eb99e45-34cb-4a04-b528-63d437bb08b1 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:35.079175 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8eb99e45-34cb-4a04-b528-63d437bb08b1 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:35.085071 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=100 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:16:35.176552 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-525f2f84-7da0-4ff7-9f64-ff1ae3d13aac tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:35.185907 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-525f2f84-7da0-4ff7-9f64-ff1ae3d13aac tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0" status: 200 len: 1502 microversion: 2.1 time: 1.009536 Jul 22 11:16:35.190716 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 162/329] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:34 2022] GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0 => generated 1502 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:16:35.208418 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-aceb62fa-1b8b-402f-a533-92305b64129e tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "62d5aa9e-6959-4d51-acf6-7f5af510fca2"}} {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:16:35.209784 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-aceb62fa-1b8b-402f-a533-92305b64129e tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: fbf8cb41-3496-45fe-9392-6add8f6873d0] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:35.226741 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-aceb62fa-1b8b-402f-a533-92305b64129e tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:35.235329 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-aceb62fa-1b8b-402f-a533-92305b64129e tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:35.238336 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-aceb62fa-1b8b-402f-a533-92305b64129e tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:35.239554 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-aceb62fa-1b8b-402f-a533-92305b64129e tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:35.298369 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.wsgi [None req-aceb62fa-1b8b-402f-a533-92305b64129e tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] HTTP exception thrown: Cannot 'attach_volume' instance fbf8cb41-3496-45fe-9392-6add8f6873d0 while it is in vm_state rescued Jul 22 11:16:35.302337 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-aceb62fa-1b8b-402f-a533-92305b64129e tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Request method failure captured: Jul 22 11:16:35.302337 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: request: POST /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0/os-volume_attachments HTTP/1.1 Jul 22 11:16:35.302337 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Accept: application/json Jul 22 11:16:35.302337 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Accept-Encoding: identity Jul 22 11:16:35.302337 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Connection: close Jul 22 11:16:35.302337 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Content-Length: 74 Jul 22 11:16:35.302337 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Content-Type: application/json Jul 22 11:16:35.302337 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Host: 10.222.0.20 Jul 22 11:16:35.302337 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Openstack-System-Scope: None Jul 22 11:16:35.302337 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: User-Agent: python-urllib3/1.26.9 Jul 22 11:16:35.302337 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Auth-Token: gAAAAABi2oZ_Qtszk4MNpu9uH6l3EUMK_AOOmV9E0vuS3FH7JkDwedj0MokFDNI6ti-i3aiOV4rP5TlBIaseQX6BcCMnHyQc2puFc3igItuqN6Fa-5lAd9CC5ZoEig99yVdCpczVS8L09dtiY0BgUBiyP4qmW8wj6-arLdMtONe-36WcUI5-aNY Jul 22 11:16:35.302337 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Domain-Id: None Jul 22 11:16:35.302337 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Domain-Name: None Jul 22 11:16:35.302337 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Identity-Status: Confirmed Jul 22 11:16:35.302337 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Is-Admin-Project: True Jul 22 11:16:35.302337 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Domain-Id: default Jul 22 11:16:35.302337 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Domain-Name: Default Jul 22 11:16:35.302337 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Id: 601d12851417478a8b39bbf0c9fcd03d Jul 22 11:16:35.302337 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-821389900 Jul 22 11:16:35.302337 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Role: reader,member Jul 22 11:16:35.302337 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Roles: reader,member Jul 22 11:16:35.303917 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/601d12851417478a8b39bbf0c9fcd03d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_601d12851417478a8b39bbf0c9fcd03d", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/601d12851417478a8b39bbf0c9fcd03d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/601d12851417478a8b39bbf0c9fcd03d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jul 22 11:16:35.303917 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant: tempest-ServerRescueNegativeTestJSON-821389900 Jul 22 11:16:35.303917 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant-Id: 601d12851417478a8b39bbf0c9fcd03d Jul 22 11:16:35.303917 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-821389900 Jul 22 11:16:35.303917 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User: tempest-ServerRescueNegativeTestJSON-821389900-project Jul 22 11:16:35.303917 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Domain-Id: default Jul 22 11:16:35.303917 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Domain-Name: Default Jul 22 11:16:35.303917 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Id: 7c2c0270618240de8fd9290d01a7413a Jul 22 11:16:35.303917 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Name: tempest-ServerRescueNegativeTestJSON-821389900-project Jul 22 11:16:35.303917 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Jul 22 11:16:35.303917 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: {"volumeAttachment": {"volumeId": "62d5aa9e-6959-4d51-acf6-7f5af510fca2"}} Jul 22 11:16:35.303917 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: method: > Jul 22 11:16:35.304766 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: exception: Cannot 'attach_volume' instance fbf8cb41-3496-45fe-9392-6add8f6873d0 while it is in vm_state rescued Jul 22 11:16:35.304766 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: action_args: {'server_id': 'fbf8cb41-3496-45fe-9392-6add8f6873d0', 'body': {'volumeAttachment': {'volumeId': '62d5aa9e-6959-4d51-acf6-7f5af510fca2'}}} Jul 22 11:16:35.304766 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 22 11:16:35.304766 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:16:35.304766 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 22 11:16:35.304766 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 22 11:16:35.304766 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 22 11:16:35.304766 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 22 11:16:35.304766 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 22 11:16:35.304766 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 22 11:16:35.304766 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance fbf8cb41-3496-45fe-9392-6add8f6873d0 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 22 11:16:35.304766 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:16:35.304766 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:16:35.304766 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:16:35.304766 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:16:35.304766 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:16:35.304766 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:16:35.304766 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 22 11:16:35.304766 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 22 11:16:35.305909 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 22 11:16:35.305909 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 22 11:16:35.305909 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 22 11:16:35.305909 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 22 11:16:35.305909 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 22 11:16:35.305909 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 22 11:16:35.305909 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 22 11:16:35.305909 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 22 11:16:35.305909 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 22 11:16:35.305909 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 22 11:16:35.305909 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 22 11:16:35.305909 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 22 11:16:35.305909 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance fbf8cb41-3496-45fe-9392-6add8f6873d0 while it is in vm_state rescued Jul 22 11:16:35.305909 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:16:35.305909 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:16:35.305909 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:16:35.305909 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:16:35.305909 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:16:35.305909 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:16:35.307050 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 22 11:16:35.307050 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 22 11:16:35.307050 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance fbf8cb41-3496-45fe-9392-6add8f6873d0 while it is in vm_state rescued Jul 22 11:16:35.307050 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:16:35.307050 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-aceb62fa-1b8b-402f-a533-92305b64129e tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Returning 409 to user: Cannot 'attach_volume' instance fbf8cb41-3496-45fe-9392-6add8f6873d0 while it is in vm_state rescued {{(pid=117884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 22 11:16:35.307050 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-aceb62fa-1b8b-402f-a533-92305b64129e tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "POST /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.101171 Jul 22 11:16:35.308313 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 163/330] 10.222.0.20 () {60 vars in 1322 bytes} [Fri Jul 22 11:16:35 2022] POST /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0/os-volume_attachments => generated 152 bytes in 104 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 22 11:16:35.319617 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-ffc62591-0158-426c-820f-c9b295a161d7 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:16:35.320254 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-ffc62591-0158-426c-820f-c9b295a161d7 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: fbf8cb41-3496-45fe-9392-6add8f6873d0] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:35.327634 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-ffc62591-0158-426c-820f-c9b295a161d7 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:35.328093 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-ffc62591-0158-426c-820f-c9b295a161d7 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:35.328930 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-ffc62591-0158-426c-820f-c9b295a161d7 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:35.329370 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-ffc62591-0158-426c-820f-c9b295a161d7 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:35.393456 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-8eb99e45-34cb-4a04-b528-63d437bb08b1 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e908d2b09dfc4a139d9c27f52580e15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84fa2f397c54be1b409d8be5ebc8491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:35.423764 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-8eb99e45-34cb-4a04-b528-63d437bb08b1 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] 10.222.0.20 "GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6" status: 200 len: 1358 microversion: 2.1 time: 0.372895 Jul 22 11:16:35.425234 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 168/331] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:35 2022] GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6 => generated 1358 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:16:35.497731 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-ffc62591-0158-426c-820f-c9b295a161d7 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "POST /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0/action" status: 202 len: 0 microversion: 2.1 time: 0.183534 Jul 22 11:16:35.500335 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 164/332] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Jul 22 11:16:35 2022] POST /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 22 11:16:35.533955 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-ab882eb5-ac2b-42d3-b18c-e094185537cd tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:35.535975 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-ab882eb5-ac2b-42d3-b18c-e094185537cd tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: fbf8cb41-3496-45fe-9392-6add8f6873d0] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:35.553886 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ab882eb5-ac2b-42d3-b18c-e094185537cd tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:35.555001 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ab882eb5-ac2b-42d3-b18c-e094185537cd tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:35.559057 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ab882eb5-ac2b-42d3-b18c-e094185537cd tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:35.561598 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ab882eb5-ac2b-42d3-b18c-e094185537cd tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:35.814305 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-ab882eb5-ac2b-42d3-b18c-e094185537cd tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:35.824485 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-ab882eb5-ac2b-42d3-b18c-e094185537cd tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0" status: 200 len: 1510 microversion: 2.1 time: 0.315646 Jul 22 11:16:35.825980 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 169/333] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:35 2022] GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0 => generated 1510 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:16:35.980860 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-f97d839c-fc67-4fbe-9983-623f5385f9bf tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:35.982176 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-f97d839c-fc67-4fbe-9983-623f5385f9bf tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: d50614d9-5b91-43b0-952b-d5ecc987e85a] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:35.989935 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f97d839c-fc67-4fbe-9983-623f5385f9bf tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:35.990544 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f97d839c-fc67-4fbe-9983-623f5385f9bf tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:35.991649 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f97d839c-fc67-4fbe-9983-623f5385f9bf tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:35.992210 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f97d839c-fc67-4fbe-9983-623f5385f9bf tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:36.114010 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-f97d839c-fc67-4fbe-9983-623f5385f9bf tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:36.123730 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-f97d839c-fc67-4fbe-9983-623f5385f9bf tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/d50614d9-5b91-43b0-952b-d5ecc987e85a" status: 200 len: 1237 microversion: 2.1 time: 0.147401 Jul 22 11:16:36.124529 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 165/334] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:35 2022] GET /compute/v2.1/servers/d50614d9-5b91-43b0-952b-d5ecc987e85a => generated 1237 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:16:36.454383 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-0b4d859e-f8ad-47d8-b9f9-3579a8f64852 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:36.455168 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-0b4d859e-f8ad-47d8-b9f9-3579a8f64852 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] [instance: 39fe8666-e4cc-464c-9af9-bd43835bccf6] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:36.463510 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0b4d859e-f8ad-47d8-b9f9-3579a8f64852 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:36.464361 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0b4d859e-f8ad-47d8-b9f9-3579a8f64852 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:36.470024 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0b4d859e-f8ad-47d8-b9f9-3579a8f64852 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:36.471707 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0b4d859e-f8ad-47d8-b9f9-3579a8f64852 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:36.488627 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [req-d68cda09-6fa0-4067-b63f-a2c5294531f3 req-90a62d1c-cf7b-48ec-a3fb-d52b1c0ba8f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f27dab8-c005-4dd0-b262-542deb60dd54", "tag": "019d06a1-2c6e-4ebb-b1f0-a080fc8a2fef"}]} {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:16:36.498221 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-d68cda09-6fa0-4067-b63f-a2c5294531f3 req-90a62d1c-cf7b-48ec-a3fb-d52b1c0ba8f1 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:36.499025 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-d68cda09-6fa0-4067-b63f-a2c5294531f3 req-90a62d1c-cf7b-48ec-a3fb-d52b1c0ba8f1 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:36.511195 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.compute.server_external_events [req-d68cda09-6fa0-4067-b63f-a2c5294531f3 req-90a62d1c-cf7b-48ec-a3fb-d52b1c0ba8f1 service nova] Creating event network-changed:019d06a1-2c6e-4ebb-b1f0-a080fc8a2fef for instance 1f27dab8-c005-4dd0-b262-542deb60dd54 on hv-cinder-84890 Jul 22 11:16:36.517990 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [req-d68cda09-6fa0-4067-b63f-a2c5294531f3 req-90a62d1c-cf7b-48ec-a3fb-d52b1c0ba8f1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033143 Jul 22 11:16:36.522321 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 166/335] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:16:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 22 11:16:36.670875 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-0b4d859e-f8ad-47d8-b9f9-3579a8f64852 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e908d2b09dfc4a139d9c27f52580e15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84fa2f397c54be1b409d8be5ebc8491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:36.678971 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-0b4d859e-f8ad-47d8-b9f9-3579a8f64852 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] 10.222.0.20 "GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6" status: 200 len: 1358 microversion: 2.1 time: 0.230697 Jul 22 11:16:36.688882 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 170/336] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:36 2022] GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6 => generated 1358 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:16:36.852235 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-37cc05d3-7833-4bf6-aa6f-1c48c7dc0d5d tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:36.853074 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-37cc05d3-7833-4bf6-aa6f-1c48c7dc0d5d tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: fbf8cb41-3496-45fe-9392-6add8f6873d0] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:36.861098 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-37cc05d3-7833-4bf6-aa6f-1c48c7dc0d5d tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:36.861416 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-37cc05d3-7833-4bf6-aa6f-1c48c7dc0d5d tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:36.862096 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-37cc05d3-7833-4bf6-aa6f-1c48c7dc0d5d tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:36.862669 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-37cc05d3-7833-4bf6-aa6f-1c48c7dc0d5d tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:37.067082 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-37cc05d3-7833-4bf6-aa6f-1c48c7dc0d5d tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:37.081752 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-37cc05d3-7833-4bf6-aa6f-1c48c7dc0d5d tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0" status: 200 len: 1510 microversion: 2.1 time: 0.241063 Jul 22 11:16:37.082935 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 167/337] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:36 2022] GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0 => generated 1510 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:16:37.144613 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-419b6457-986b-4f04-807b-1c2c73a53ba4 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:37.145582 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-419b6457-986b-4f04-807b-1c2c73a53ba4 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: d50614d9-5b91-43b0-952b-d5ecc987e85a] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:37.155896 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-419b6457-986b-4f04-807b-1c2c73a53ba4 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:37.156517 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-419b6457-986b-4f04-807b-1c2c73a53ba4 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:37.157680 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-419b6457-986b-4f04-807b-1c2c73a53ba4 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:37.158321 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-419b6457-986b-4f04-807b-1c2c73a53ba4 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:37.272835 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-419b6457-986b-4f04-807b-1c2c73a53ba4 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:37.284995 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-419b6457-986b-4f04-807b-1c2c73a53ba4 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/d50614d9-5b91-43b0-952b-d5ecc987e85a" status: 200 len: 1237 microversion: 2.1 time: 0.145266 Jul 22 11:16:37.299795 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 171/338] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:37 2022] GET /compute/v2.1/servers/d50614d9-5b91-43b0-952b-d5ecc987e85a => generated 1237 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:16:37.701063 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-80b02d31-bc85-4f78-b2ba-5961f2ddbff0 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:37.704248 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-80b02d31-bc85-4f78-b2ba-5961f2ddbff0 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] [instance: 39fe8666-e4cc-464c-9af9-bd43835bccf6] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:37.711452 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-80b02d31-bc85-4f78-b2ba-5961f2ddbff0 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:37.711902 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-80b02d31-bc85-4f78-b2ba-5961f2ddbff0 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:37.712785 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-80b02d31-bc85-4f78-b2ba-5961f2ddbff0 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:37.713213 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-80b02d31-bc85-4f78-b2ba-5961f2ddbff0 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:37.904890 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-80b02d31-bc85-4f78-b2ba-5961f2ddbff0 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e908d2b09dfc4a139d9c27f52580e15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84fa2f397c54be1b409d8be5ebc8491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:37.913236 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-80b02d31-bc85-4f78-b2ba-5961f2ddbff0 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] 10.222.0.20 "GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6" status: 200 len: 1358 microversion: 2.1 time: 0.219522 Jul 22 11:16:37.913820 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 168/339] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:37 2022] GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6 => generated 1358 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:16:38.112411 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-843752f8-241a-4657-b0f0-7260b302ec8b tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:38.117850 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-843752f8-241a-4657-b0f0-7260b302ec8b tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: fbf8cb41-3496-45fe-9392-6add8f6873d0] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:38.157681 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-843752f8-241a-4657-b0f0-7260b302ec8b tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:38.158431 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-843752f8-241a-4657-b0f0-7260b302ec8b tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:38.159682 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-843752f8-241a-4657-b0f0-7260b302ec8b tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:38.160309 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-843752f8-241a-4657-b0f0-7260b302ec8b tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:38.308835 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-bdcc4713-4a97-4397-8e7e-b329e202116b tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:38.310160 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-bdcc4713-4a97-4397-8e7e-b329e202116b tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: d50614d9-5b91-43b0-952b-d5ecc987e85a] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:38.316961 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-bdcc4713-4a97-4397-8e7e-b329e202116b tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:38.318880 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-bdcc4713-4a97-4397-8e7e-b329e202116b tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:38.318880 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-bdcc4713-4a97-4397-8e7e-b329e202116b tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:38.318880 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-bdcc4713-4a97-4397-8e7e-b329e202116b tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:38.415572 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-bdcc4713-4a97-4397-8e7e-b329e202116b tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:38.424471 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-bdcc4713-4a97-4397-8e7e-b329e202116b tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/d50614d9-5b91-43b0-952b-d5ecc987e85a" status: 200 len: 1237 microversion: 2.1 time: 0.119618 Jul 22 11:16:38.425468 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 169/340] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:38 2022] GET /compute/v2.1/servers/d50614d9-5b91-43b0-952b-d5ecc987e85a => generated 1237 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:16:38.598721 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-843752f8-241a-4657-b0f0-7260b302ec8b tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:38.612400 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-843752f8-241a-4657-b0f0-7260b302ec8b tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0" status: 200 len: 1510 microversion: 2.1 time: 0.511731 Jul 22 11:16:38.613438 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 172/341] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:38 2022] GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0 => generated 1510 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:16:38.945156 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-06c04542-61e4-431c-b48a-f8c2e4317797 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:38.946474 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-06c04542-61e4-431c-b48a-f8c2e4317797 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] [instance: 39fe8666-e4cc-464c-9af9-bd43835bccf6] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:38.958728 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-06c04542-61e4-431c-b48a-f8c2e4317797 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:38.959401 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-06c04542-61e4-431c-b48a-f8c2e4317797 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:38.960563 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-06c04542-61e4-431c-b48a-f8c2e4317797 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:38.961167 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-06c04542-61e4-431c-b48a-f8c2e4317797 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:39.148330 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-06c04542-61e4-431c-b48a-f8c2e4317797 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e908d2b09dfc4a139d9c27f52580e15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84fa2f397c54be1b409d8be5ebc8491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:39.156738 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-06c04542-61e4-431c-b48a-f8c2e4317797 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] 10.222.0.20 "GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6" status: 200 len: 1358 microversion: 2.1 time: 0.220642 Jul 22 11:16:39.157347 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 170/342] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:38 2022] GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6 => generated 1358 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:16:39.445607 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-56ee8189-eacf-4513-945e-4ba1eccd11e6 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:39.446144 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-56ee8189-eacf-4513-945e-4ba1eccd11e6 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: d50614d9-5b91-43b0-952b-d5ecc987e85a] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:39.448540 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:16:39.454684 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-56ee8189-eacf-4513-945e-4ba1eccd11e6 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:39.455168 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-56ee8189-eacf-4513-945e-4ba1eccd11e6 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:39.456040 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-56ee8189-eacf-4513-945e-4ba1eccd11e6 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:39.456472 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-56ee8189-eacf-4513-945e-4ba1eccd11e6 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:39.537978 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-56ee8189-eacf-4513-945e-4ba1eccd11e6 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:39.551139 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-56ee8189-eacf-4513-945e-4ba1eccd11e6 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/d50614d9-5b91-43b0-952b-d5ecc987e85a" status: 200 len: 1293 microversion: 2.1 time: 0.109264 Jul 22 11:16:39.552474 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 173/343] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:39 2022] GET /compute/v2.1/servers/d50614d9-5b91-43b0-952b-d5ecc987e85a => generated 1293 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:16:39.635872 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-706f40fd-71f7-4065-b747-c8c5225a99d5 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:39.637430 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-706f40fd-71f7-4065-b747-c8c5225a99d5 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: fbf8cb41-3496-45fe-9392-6add8f6873d0] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:39.648416 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-706f40fd-71f7-4065-b747-c8c5225a99d5 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:39.649840 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-706f40fd-71f7-4065-b747-c8c5225a99d5 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:39.650949 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-706f40fd-71f7-4065-b747-c8c5225a99d5 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:39.651755 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-706f40fd-71f7-4065-b747-c8c5225a99d5 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:39.847089 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-706f40fd-71f7-4065-b747-c8c5225a99d5 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:39.858653 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-706f40fd-71f7-4065-b747-c8c5225a99d5 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0" status: 200 len: 1510 microversion: 2.1 time: 0.231036 Jul 22 11:16:39.859708 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 171/344] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:39 2022] GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0 => generated 1510 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:16:40.174140 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-e2b139e4-bfa3-40a4-90a9-f9d92c2483ea tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:40.174894 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-e2b139e4-bfa3-40a4-90a9-f9d92c2483ea tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] [instance: 39fe8666-e4cc-464c-9af9-bd43835bccf6] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:40.181721 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e2b139e4-bfa3-40a4-90a9-f9d92c2483ea tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:40.182163 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e2b139e4-bfa3-40a4-90a9-f9d92c2483ea tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:40.183107 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e2b139e4-bfa3-40a4-90a9-f9d92c2483ea tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:40.183572 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e2b139e4-bfa3-40a4-90a9-f9d92c2483ea tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:40.395918 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-e2b139e4-bfa3-40a4-90a9-f9d92c2483ea tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e908d2b09dfc4a139d9c27f52580e15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84fa2f397c54be1b409d8be5ebc8491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:40.410520 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-e2b139e4-bfa3-40a4-90a9-f9d92c2483ea tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] 10.222.0.20 "GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6" status: 200 len: 1358 microversion: 2.1 time: 0.240096 Jul 22 11:16:40.411615 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 174/345] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:40 2022] GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6 => generated 1358 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:16:40.576075 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-309e8943-237a-45b0-8408-5d321863416a tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:40.577221 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-309e8943-237a-45b0-8408-5d321863416a tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: d50614d9-5b91-43b0-952b-d5ecc987e85a] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:40.592139 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-309e8943-237a-45b0-8408-5d321863416a tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:40.592716 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-309e8943-237a-45b0-8408-5d321863416a tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:40.593781 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-309e8943-237a-45b0-8408-5d321863416a tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:40.594361 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-309e8943-237a-45b0-8408-5d321863416a tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:40.599933 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG dbcounter [-] [117884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:16:40.711858 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-309e8943-237a-45b0-8408-5d321863416a tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:40.734290 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-309e8943-237a-45b0-8408-5d321863416a tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/d50614d9-5b91-43b0-952b-d5ecc987e85a" status: 200 len: 1293 microversion: 2.1 time: 0.165785 Jul 22 11:16:40.735608 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 172/346] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:40 2022] GET /compute/v2.1/servers/d50614d9-5b91-43b0-952b-d5ecc987e85a => generated 1293 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:16:40.891474 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-4395bec5-5c2d-478c-9369-d753ad8699d1 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:40.893433 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-4395bec5-5c2d-478c-9369-d753ad8699d1 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: fbf8cb41-3496-45fe-9392-6add8f6873d0] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:40.908564 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4395bec5-5c2d-478c-9369-d753ad8699d1 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:40.910314 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4395bec5-5c2d-478c-9369-d753ad8699d1 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:40.911064 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4395bec5-5c2d-478c-9369-d753ad8699d1 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:40.911867 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4395bec5-5c2d-478c-9369-d753ad8699d1 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:41.103076 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-4395bec5-5c2d-478c-9369-d753ad8699d1 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:41.117412 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-4395bec5-5c2d-478c-9369-d753ad8699d1 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0" status: 200 len: 1510 microversion: 2.1 time: 0.235999 Jul 22 11:16:41.118512 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 175/347] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:40 2022] GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0 => generated 1510 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:16:41.432728 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-182d8384-4337-46a4-939b-13d6f8d63ce3 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:41.433631 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-182d8384-4337-46a4-939b-13d6f8d63ce3 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] [instance: 39fe8666-e4cc-464c-9af9-bd43835bccf6] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:41.442815 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-182d8384-4337-46a4-939b-13d6f8d63ce3 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:41.443318 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-182d8384-4337-46a4-939b-13d6f8d63ce3 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:41.444141 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-182d8384-4337-46a4-939b-13d6f8d63ce3 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:41.444586 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-182d8384-4337-46a4-939b-13d6f8d63ce3 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:41.606487 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-182d8384-4337-46a4-939b-13d6f8d63ce3 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e908d2b09dfc4a139d9c27f52580e15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84fa2f397c54be1b409d8be5ebc8491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:41.624260 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-182d8384-4337-46a4-939b-13d6f8d63ce3 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] 10.222.0.20 "GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6" status: 200 len: 1358 microversion: 2.1 time: 0.197733 Jul 22 11:16:41.625396 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 173/348] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:41 2022] GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6 => generated 1358 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:16:41.761415 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-28ed39c5-c8d2-4e09-b029-ebbb91b4b45d tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:41.761968 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-28ed39c5-c8d2-4e09-b029-ebbb91b4b45d tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: d50614d9-5b91-43b0-952b-d5ecc987e85a] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:41.772390 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-28ed39c5-c8d2-4e09-b029-ebbb91b4b45d tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:41.773147 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-28ed39c5-c8d2-4e09-b029-ebbb91b4b45d tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:41.774401 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-28ed39c5-c8d2-4e09-b029-ebbb91b4b45d tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:41.775142 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-28ed39c5-c8d2-4e09-b029-ebbb91b4b45d tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:41.866953 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-28ed39c5-c8d2-4e09-b029-ebbb91b4b45d tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:41.880724 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-28ed39c5-c8d2-4e09-b029-ebbb91b4b45d tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/d50614d9-5b91-43b0-952b-d5ecc987e85a" status: 200 len: 1293 microversion: 2.1 time: 0.123280 Jul 22 11:16:41.881598 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 176/349] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:41 2022] GET /compute/v2.1/servers/d50614d9-5b91-43b0-952b-d5ecc987e85a => generated 1293 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:16:42.137024 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-77504d58-438f-45e7-a4e7-9bebebe9053d tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:42.137753 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-77504d58-438f-45e7-a4e7-9bebebe9053d tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: fbf8cb41-3496-45fe-9392-6add8f6873d0] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:42.144376 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-77504d58-438f-45e7-a4e7-9bebebe9053d tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:42.144817 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-77504d58-438f-45e7-a4e7-9bebebe9053d tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:42.145593 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-77504d58-438f-45e7-a4e7-9bebebe9053d tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:42.146018 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-77504d58-438f-45e7-a4e7-9bebebe9053d tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:42.304554 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-77504d58-438f-45e7-a4e7-9bebebe9053d tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:42.313059 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-77504d58-438f-45e7-a4e7-9bebebe9053d tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0" status: 200 len: 1510 microversion: 2.1 time: 0.180061 Jul 22 11:16:42.313781 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 174/350] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:42 2022] GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0 => generated 1510 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:16:42.648957 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-46c69297-0e59-43ce-9f3d-b8f071464260 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:42.649864 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-46c69297-0e59-43ce-9f3d-b8f071464260 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] [instance: 39fe8666-e4cc-464c-9af9-bd43835bccf6] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:42.656771 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-46c69297-0e59-43ce-9f3d-b8f071464260 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:42.657252 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-46c69297-0e59-43ce-9f3d-b8f071464260 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:42.658137 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-46c69297-0e59-43ce-9f3d-b8f071464260 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:42.658794 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-46c69297-0e59-43ce-9f3d-b8f071464260 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:42.810883 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-46c69297-0e59-43ce-9f3d-b8f071464260 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e908d2b09dfc4a139d9c27f52580e15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84fa2f397c54be1b409d8be5ebc8491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:42.826082 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-46c69297-0e59-43ce-9f3d-b8f071464260 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] 10.222.0.20 "GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6" status: 200 len: 1358 microversion: 2.1 time: 0.181042 Jul 22 11:16:42.826710 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 177/351] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:42 2022] GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6 => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:16:42.902067 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-999bbe2c-49a2-4037-a4c4-b3d1d4af85c0 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:42.902752 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-999bbe2c-49a2-4037-a4c4-b3d1d4af85c0 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: d50614d9-5b91-43b0-952b-d5ecc987e85a] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:42.909795 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-999bbe2c-49a2-4037-a4c4-b3d1d4af85c0 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:42.910528 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-999bbe2c-49a2-4037-a4c4-b3d1d4af85c0 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:42.911560 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-999bbe2c-49a2-4037-a4c4-b3d1d4af85c0 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:42.912191 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-999bbe2c-49a2-4037-a4c4-b3d1d4af85c0 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:42.977824 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-999bbe2c-49a2-4037-a4c4-b3d1d4af85c0 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:42.985859 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-999bbe2c-49a2-4037-a4c4-b3d1d4af85c0 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/d50614d9-5b91-43b0-952b-d5ecc987e85a" status: 200 len: 1293 microversion: 2.1 time: 0.087640 Jul 22 11:16:42.986444 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 175/352] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:42 2022] GET /compute/v2.1/servers/d50614d9-5b91-43b0-952b-d5ecc987e85a => generated 1293 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:16:43.330834 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-407c9177-f8db-470b-989d-420f4d4cfe64 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:43.331491 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-407c9177-f8db-470b-989d-420f4d4cfe64 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: fbf8cb41-3496-45fe-9392-6add8f6873d0] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:43.337666 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-407c9177-f8db-470b-989d-420f4d4cfe64 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:43.338098 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-407c9177-f8db-470b-989d-420f4d4cfe64 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:43.338859 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-407c9177-f8db-470b-989d-420f4d4cfe64 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:43.339319 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-407c9177-f8db-470b-989d-420f4d4cfe64 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:43.470523 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-407c9177-f8db-470b-989d-420f4d4cfe64 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:43.478541 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-407c9177-f8db-470b-989d-420f4d4cfe64 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0" status: 200 len: 1510 microversion: 2.1 time: 0.151088 Jul 22 11:16:43.479156 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 178/353] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:43 2022] GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0 => generated 1510 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:16:43.862062 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-acdc6b64-263f-47a7-ae21-46c4932989e1 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:43.863513 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-acdc6b64-263f-47a7-ae21-46c4932989e1 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] [instance: 39fe8666-e4cc-464c-9af9-bd43835bccf6] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:43.879224 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-acdc6b64-263f-47a7-ae21-46c4932989e1 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:43.882510 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-acdc6b64-263f-47a7-ae21-46c4932989e1 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:43.884338 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-acdc6b64-263f-47a7-ae21-46c4932989e1 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:43.885164 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-acdc6b64-263f-47a7-ae21-46c4932989e1 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:44.004113 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-6c2911ce-b747-45d9-811c-0b583b36087b tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:44.005436 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-6c2911ce-b747-45d9-811c-0b583b36087b tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: d50614d9-5b91-43b0-952b-d5ecc987e85a] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:44.018871 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6c2911ce-b747-45d9-811c-0b583b36087b tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:44.019715 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6c2911ce-b747-45d9-811c-0b583b36087b tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:44.021611 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6c2911ce-b747-45d9-811c-0b583b36087b tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:44.022395 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6c2911ce-b747-45d9-811c-0b583b36087b tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:44.131753 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-6c2911ce-b747-45d9-811c-0b583b36087b tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:44.145927 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-6c2911ce-b747-45d9-811c-0b583b36087b tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/d50614d9-5b91-43b0-952b-d5ecc987e85a" status: 200 len: 1301 microversion: 2.1 time: 0.147362 Jul 22 11:16:44.159921 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 179/354] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:43 2022] GET /compute/v2.1/servers/d50614d9-5b91-43b0-952b-d5ecc987e85a => generated 1301 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:16:44.500923 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-9c76119d-ba07-495a-9d91-4a8b0794bc57 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:44.502378 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-9c76119d-ba07-495a-9d91-4a8b0794bc57 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: fbf8cb41-3496-45fe-9392-6add8f6873d0] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:44.524266 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9c76119d-ba07-495a-9d91-4a8b0794bc57 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:44.525163 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9c76119d-ba07-495a-9d91-4a8b0794bc57 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:44.526147 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9c76119d-ba07-495a-9d91-4a8b0794bc57 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:44.526884 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9c76119d-ba07-495a-9d91-4a8b0794bc57 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:44.562295 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-acdc6b64-263f-47a7-ae21-46c4932989e1 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e908d2b09dfc4a139d9c27f52580e15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84fa2f397c54be1b409d8be5ebc8491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:44.573708 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-acdc6b64-263f-47a7-ae21-46c4932989e1 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] 10.222.0.20 "GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6" status: 200 len: 1358 microversion: 2.1 time: 0.720061 Jul 22 11:16:44.576967 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 176/355] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:43 2022] GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6 => generated 1358 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:16:44.664486 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell0:SELECT=2 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:16:44.766414 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-f1a1635d-ddab-4cca-a555-17008abb2e75 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:16:44.777562 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f1a1635d-ddab-4cca-a555-17008abb2e75 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:44.781346 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f1a1635d-ddab-4cca-a555-17008abb2e75 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:44.860474 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-f1a1635d-ddab-4cca-a555-17008abb2e75 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Going to try to stop instance {{(pid=117884) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 22 11:16:44.927852 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-9c76119d-ba07-495a-9d91-4a8b0794bc57 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:44.946613 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-9c76119d-ba07-495a-9d91-4a8b0794bc57 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0" status: 200 len: 1510 microversion: 2.1 time: 0.452796 Jul 22 11:16:44.947941 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-f1a1635d-ddab-4cca-a555-17008abb2e75 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "POST /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1/action" status: 202 len: 0 microversion: 2.1 time: 0.186641 Jul 22 11:16:44.951890 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 177/356] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Jul 22 11:16:44 2022] POST /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1/action => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 22 11:16:44.958762 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-34469381-6703-40ae-a1d3-32c0c9f2e5c9 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:44.959719 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-34469381-6703-40ae-a1d3-32c0c9f2e5c9 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:44.966367 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-34469381-6703-40ae-a1d3-32c0c9f2e5c9 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:44.967283 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-34469381-6703-40ae-a1d3-32c0c9f2e5c9 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:44.968272 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-34469381-6703-40ae-a1d3-32c0c9f2e5c9 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:44.968453 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 180/357] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:44 2022] GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0 => generated 1510 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:16:44.969276 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-34469381-6703-40ae-a1d3-32c0c9f2e5c9 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:45.175152 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell0:SELECT=12 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:16:45.184854 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-34469381-6703-40ae-a1d3-32c0c9f2e5c9 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:45.196372 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-1a272e67-bb54-42a4-94e8-abe045c21f32 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:45.199499 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-1a272e67-bb54-42a4-94e8-abe045c21f32 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: d50614d9-5b91-43b0-952b-d5ecc987e85a] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:45.211795 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-34469381-6703-40ae-a1d3-32c0c9f2e5c9 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1721 microversion: 2.1 time: 0.257317 Jul 22 11:16:45.214745 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 178/358] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:44 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1721 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:16:45.215561 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1a272e67-bb54-42a4-94e8-abe045c21f32 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:45.216278 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1a272e67-bb54-42a4-94e8-abe045c21f32 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:45.217695 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1a272e67-bb54-42a4-94e8-abe045c21f32 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:45.218731 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1a272e67-bb54-42a4-94e8-abe045c21f32 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:45.365216 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-1a272e67-bb54-42a4-94e8-abe045c21f32 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:45.382401 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-1a272e67-bb54-42a4-94e8-abe045c21f32 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/d50614d9-5b91-43b0-952b-d5ecc987e85a" status: 200 len: 1299 microversion: 2.1 time: 0.208533 Jul 22 11:16:45.394119 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 181/359] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:45 2022] GET /compute/v2.1/servers/d50614d9-5b91-43b0-952b-d5ecc987e85a => generated 1299 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:16:45.616659 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-c03e4f91-2a2b-4ae3-b23d-67b2b9b71054 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:45.618902 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-c03e4f91-2a2b-4ae3-b23d-67b2b9b71054 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] [instance: 39fe8666-e4cc-464c-9af9-bd43835bccf6] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:45.630189 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c03e4f91-2a2b-4ae3-b23d-67b2b9b71054 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:45.631604 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c03e4f91-2a2b-4ae3-b23d-67b2b9b71054 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:45.633277 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c03e4f91-2a2b-4ae3-b23d-67b2b9b71054 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:45.634073 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c03e4f91-2a2b-4ae3-b23d-67b2b9b71054 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:45.829979 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-c03e4f91-2a2b-4ae3-b23d-67b2b9b71054 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e908d2b09dfc4a139d9c27f52580e15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84fa2f397c54be1b409d8be5ebc8491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:45.843134 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-c03e4f91-2a2b-4ae3-b23d-67b2b9b71054 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] 10.222.0.20 "GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6" status: 200 len: 1358 microversion: 2.1 time: 0.238081 Jul 22 11:16:45.843988 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 179/360] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:45 2022] GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6 => generated 1358 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:16:45.984860 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-96fe95ad-c876-4bcb-9250-e440ac855ddc tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:45.985481 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-96fe95ad-c876-4bcb-9250-e440ac855ddc tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: fbf8cb41-3496-45fe-9392-6add8f6873d0] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:45.995175 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-96fe95ad-c876-4bcb-9250-e440ac855ddc tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:45.995637 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-96fe95ad-c876-4bcb-9250-e440ac855ddc tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:45.996453 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-96fe95ad-c876-4bcb-9250-e440ac855ddc tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:45.997000 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-96fe95ad-c876-4bcb-9250-e440ac855ddc tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:46.148415 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-96fe95ad-c876-4bcb-9250-e440ac855ddc tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:46.158343 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-96fe95ad-c876-4bcb-9250-e440ac855ddc tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0" status: 200 len: 1510 microversion: 2.1 time: 0.177786 Jul 22 11:16:46.159393 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 182/361] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:45 2022] GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0 => generated 1510 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:16:46.239057 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-a5b5f2f6-8e0d-4e11-b0c5-ac592d4d6d5f tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:46.239877 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-a5b5f2f6-8e0d-4e11-b0c5-ac592d4d6d5f tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:46.261382 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-a5b5f2f6-8e0d-4e11-b0c5-ac592d4d6d5f tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:46.261871 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-a5b5f2f6-8e0d-4e11-b0c5-ac592d4d6d5f tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:46.262718 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-a5b5f2f6-8e0d-4e11-b0c5-ac592d4d6d5f tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:46.269270 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-a5b5f2f6-8e0d-4e11-b0c5-ac592d4d6d5f tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:46.403318 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-25d55a3c-de3e-44ce-bdbb-c2b7756787b4 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:46.404011 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-25d55a3c-de3e-44ce-bdbb-c2b7756787b4 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: d50614d9-5b91-43b0-952b-d5ecc987e85a] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:46.411115 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-25d55a3c-de3e-44ce-bdbb-c2b7756787b4 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:46.412092 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-25d55a3c-de3e-44ce-bdbb-c2b7756787b4 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:46.412527 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-25d55a3c-de3e-44ce-bdbb-c2b7756787b4 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:46.413025 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-25d55a3c-de3e-44ce-bdbb-c2b7756787b4 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:46.503826 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-a5b5f2f6-8e0d-4e11-b0c5-ac592d4d6d5f tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:46.513764 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-a5b5f2f6-8e0d-4e11-b0c5-ac592d4d6d5f tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1721 microversion: 2.1 time: 0.278532 Jul 22 11:16:46.524202 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 180/362] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:46 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1721 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:16:46.529075 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [req-cfe44603-1414-484d-802f-c4c40ce86b7c req-3c996066-5f5c-408f-bbdd-c0376b24fc72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39fe8666-e4cc-464c-9af9-bd43835bccf6", "name": "network-vif-plugged", "status": "completed", "tag": "2dfea6d8-ff88-4cd2-885a-008177cdfd33"}]} {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:16:46.539833 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-cfe44603-1414-484d-802f-c4c40ce86b7c req-3c996066-5f5c-408f-bbdd-c0376b24fc72 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:46.540835 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-cfe44603-1414-484d-802f-c4c40ce86b7c req-3c996066-5f5c-408f-bbdd-c0376b24fc72 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:46.556653 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.compute.server_external_events [req-cfe44603-1414-484d-802f-c4c40ce86b7c req-3c996066-5f5c-408f-bbdd-c0376b24fc72 service nova] Creating event network-vif-plugged:2dfea6d8-ff88-4cd2-885a-008177cdfd33 for instance 39fe8666-e4cc-464c-9af9-bd43835bccf6 on hv-cinder-84890 Jul 22 11:16:46.564771 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [req-cfe44603-1414-484d-802f-c4c40ce86b7c req-3c996066-5f5c-408f-bbdd-c0376b24fc72 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038589 Jul 22 11:16:46.564771 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 181/363] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:16:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:16:46.615247 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-25d55a3c-de3e-44ce-bdbb-c2b7756787b4 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:46.627413 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-25d55a3c-de3e-44ce-bdbb-c2b7756787b4 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/d50614d9-5b91-43b0-952b-d5ecc987e85a" status: 200 len: 1367 microversion: 2.1 time: 0.229697 Jul 22 11:16:46.628035 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 183/364] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:46 2022] GET /compute/v2.1/servers/d50614d9-5b91-43b0-952b-d5ecc987e85a => generated 1367 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:16:46.866800 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-fc604e83-7a89-4fcb-867f-673f23a509e9 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:46.868021 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-fc604e83-7a89-4fcb-867f-673f23a509e9 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] [instance: 39fe8666-e4cc-464c-9af9-bd43835bccf6] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:46.877236 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-fc604e83-7a89-4fcb-867f-673f23a509e9 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:46.877932 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-fc604e83-7a89-4fcb-867f-673f23a509e9 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:46.879495 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-fc604e83-7a89-4fcb-867f-673f23a509e9 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:46.880164 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-fc604e83-7a89-4fcb-867f-673f23a509e9 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:47.086961 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-fc604e83-7a89-4fcb-867f-673f23a509e9 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e908d2b09dfc4a139d9c27f52580e15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84fa2f397c54be1b409d8be5ebc8491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:47.096644 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-fc604e83-7a89-4fcb-867f-673f23a509e9 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] 10.222.0.20 "GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6" status: 200 len: 1358 microversion: 2.1 time: 0.235209 Jul 22 11:16:47.097415 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 182/365] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:46 2022] GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6 => generated 1358 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:16:47.188336 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-feb3ee28-5c7c-4e74-a8a6-095a41338c2e tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:47.189630 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-feb3ee28-5c7c-4e74-a8a6-095a41338c2e tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: fbf8cb41-3496-45fe-9392-6add8f6873d0] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:47.200582 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-feb3ee28-5c7c-4e74-a8a6-095a41338c2e tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:47.201338 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-feb3ee28-5c7c-4e74-a8a6-095a41338c2e tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:47.202301 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-feb3ee28-5c7c-4e74-a8a6-095a41338c2e tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:47.202905 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-feb3ee28-5c7c-4e74-a8a6-095a41338c2e tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:47.478426 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-feb3ee28-5c7c-4e74-a8a6-095a41338c2e tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:47.482372 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=100 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:16:47.493072 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-feb3ee28-5c7c-4e74-a8a6-095a41338c2e tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0" status: 200 len: 1510 microversion: 2.1 time: 0.314873 Jul 22 11:16:47.494030 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 184/366] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:47 2022] GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0 => generated 1510 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:16:47.535366 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-66f54fbd-40a4-4e07-a68e-ab7e18252a9e tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:47.544249 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-66f54fbd-40a4-4e07-a68e-ab7e18252a9e tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:47.553833 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-66f54fbd-40a4-4e07-a68e-ab7e18252a9e tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:47.555250 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-66f54fbd-40a4-4e07-a68e-ab7e18252a9e tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:47.555250 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-66f54fbd-40a4-4e07-a68e-ab7e18252a9e tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:47.555709 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-66f54fbd-40a4-4e07-a68e-ab7e18252a9e tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:47.649298 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-7161c6bb-5490-461e-b567-ffa690da145b tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:47.650600 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-7161c6bb-5490-461e-b567-ffa690da145b tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: d50614d9-5b91-43b0-952b-d5ecc987e85a] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:47.687108 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7161c6bb-5490-461e-b567-ffa690da145b tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:47.688099 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7161c6bb-5490-461e-b567-ffa690da145b tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:47.690831 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7161c6bb-5490-461e-b567-ffa690da145b tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:47.691914 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7161c6bb-5490-461e-b567-ffa690da145b tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:47.860457 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-66f54fbd-40a4-4e07-a68e-ab7e18252a9e tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:47.877455 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-66f54fbd-40a4-4e07-a68e-ab7e18252a9e tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1721 microversion: 2.1 time: 0.349162 Jul 22 11:16:47.879078 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 183/367] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:47 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1721 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:16:48.040310 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [req-7d6af13a-85cb-4efd-a4a9-6d818b5c8051 req-b6ee926c-77ee-4754-aef1-3c73b65e3b83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d50614d9-5b91-43b0-952b-d5ecc987e85a", "tag": "2f780c3c-9237-4cac-b261-2b6b1e51cc1b"}]} {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:16:48.047197 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-7161c6bb-5490-461e-b567-ffa690da145b tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:48.055752 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-7161c6bb-5490-461e-b567-ffa690da145b tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/d50614d9-5b91-43b0-952b-d5ecc987e85a" status: 200 len: 1367 microversion: 2.1 time: 0.413380 Jul 22 11:16:48.066016 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 185/368] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:47 2022] GET /compute/v2.1/servers/d50614d9-5b91-43b0-952b-d5ecc987e85a => generated 1367 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:16:48.108110 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-7d6af13a-85cb-4efd-a4a9-6d818b5c8051 req-b6ee926c-77ee-4754-aef1-3c73b65e3b83 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:48.112528 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-7d6af13a-85cb-4efd-a4a9-6d818b5c8051 req-b6ee926c-77ee-4754-aef1-3c73b65e3b83 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:48.116302 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-719885b5-095a-4727-8593-fa6915184d2f tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:48.116909 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-719885b5-095a-4727-8593-fa6915184d2f tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] [instance: 39fe8666-e4cc-464c-9af9-bd43835bccf6] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:48.133406 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-719885b5-095a-4727-8593-fa6915184d2f tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:48.135132 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-719885b5-095a-4727-8593-fa6915184d2f tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:48.136262 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-719885b5-095a-4727-8593-fa6915184d2f tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:48.136857 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-719885b5-095a-4727-8593-fa6915184d2f tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:48.167761 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.compute.server_external_events [req-7d6af13a-85cb-4efd-a4a9-6d818b5c8051 req-b6ee926c-77ee-4754-aef1-3c73b65e3b83 service nova] Creating event network-changed:2f780c3c-9237-4cac-b261-2b6b1e51cc1b for instance d50614d9-5b91-43b0-952b-d5ecc987e85a on hv-cinder-84890 Jul 22 11:16:48.191376 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [req-7d6af13a-85cb-4efd-a4a9-6d818b5c8051 req-b6ee926c-77ee-4754-aef1-3c73b65e3b83 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151318 Jul 22 11:16:48.194049 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 184/369] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:16:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 22 11:16:48.427166 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-719885b5-095a-4727-8593-fa6915184d2f tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e908d2b09dfc4a139d9c27f52580e15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84fa2f397c54be1b409d8be5ebc8491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:48.438977 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-719885b5-095a-4727-8593-fa6915184d2f tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] 10.222.0.20 "GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6" status: 200 len: 1358 microversion: 2.1 time: 0.326385 Jul 22 11:16:48.440385 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 186/370] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:48 2022] GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6 => generated 1358 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:16:48.512059 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-be28f24b-113d-4460-8c45-9918167a98a5 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:48.512802 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-be28f24b-113d-4460-8c45-9918167a98a5 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: fbf8cb41-3496-45fe-9392-6add8f6873d0] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:48.519815 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-be28f24b-113d-4460-8c45-9918167a98a5 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:48.520261 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-be28f24b-113d-4460-8c45-9918167a98a5 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:48.521183 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-be28f24b-113d-4460-8c45-9918167a98a5 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:48.521806 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-be28f24b-113d-4460-8c45-9918167a98a5 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:48.812994 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-be28f24b-113d-4460-8c45-9918167a98a5 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:48.833187 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-be28f24b-113d-4460-8c45-9918167a98a5 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0" status: 200 len: 1516 microversion: 2.1 time: 0.325381 Jul 22 11:16:48.850976 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 185/371] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:48 2022] GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0 => generated 1516 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:16:48.905510 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-3872db24-9b88-4bd0-ad29-d1ddd08999a1 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:48.908997 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-3872db24-9b88-4bd0-ad29-d1ddd08999a1 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:48.945427 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3872db24-9b88-4bd0-ad29-d1ddd08999a1 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:48.948325 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3872db24-9b88-4bd0-ad29-d1ddd08999a1 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:48.955710 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3872db24-9b88-4bd0-ad29-d1ddd08999a1 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:48.958838 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3872db24-9b88-4bd0-ad29-d1ddd08999a1 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:49.093903 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-1f9e0193-b727-4bdf-98e5-4e0454cdde7a tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:49.099510 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-1f9e0193-b727-4bdf-98e5-4e0454cdde7a tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: d50614d9-5b91-43b0-952b-d5ecc987e85a] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:49.147522 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-1f9e0193-b727-4bdf-98e5-4e0454cdde7a tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:49.148515 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-1f9e0193-b727-4bdf-98e5-4e0454cdde7a tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:49.150003 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-1f9e0193-b727-4bdf-98e5-4e0454cdde7a tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:49.150773 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-1f9e0193-b727-4bdf-98e5-4e0454cdde7a tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:49.297693 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-3872db24-9b88-4bd0-ad29-d1ddd08999a1 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:49.309739 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-3872db24-9b88-4bd0-ad29-d1ddd08999a1 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1721 microversion: 2.1 time: 0.414492 Jul 22 11:16:49.319341 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 187/372] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:48 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1721 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:16:49.445305 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-1f9e0193-b727-4bdf-98e5-4e0454cdde7a tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:49.456489 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-1f9e0193-b727-4bdf-98e5-4e0454cdde7a tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/d50614d9-5b91-43b0-952b-d5ecc987e85a" status: 200 len: 1367 microversion: 2.1 time: 0.381372 Jul 22 11:16:49.463367 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-327cb82e-786a-4a22-82ed-ca877bab4a53 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:49.464543 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-327cb82e-786a-4a22-82ed-ca877bab4a53 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] [instance: 39fe8666-e4cc-464c-9af9-bd43835bccf6] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:49.470756 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 186/373] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:49 2022] GET /compute/v2.1/servers/d50614d9-5b91-43b0-952b-d5ecc987e85a => generated 1367 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:16:49.474732 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-327cb82e-786a-4a22-82ed-ca877bab4a53 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:49.475580 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-327cb82e-786a-4a22-82ed-ca877bab4a53 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:49.476605 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-327cb82e-786a-4a22-82ed-ca877bab4a53 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:49.477207 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-327cb82e-786a-4a22-82ed-ca877bab4a53 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:49.680308 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-327cb82e-786a-4a22-82ed-ca877bab4a53 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e908d2b09dfc4a139d9c27f52580e15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84fa2f397c54be1b409d8be5ebc8491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:49.692559 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-327cb82e-786a-4a22-82ed-ca877bab4a53 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] 10.222.0.20 "GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6" status: 200 len: 1358 microversion: 2.1 time: 0.237731 Jul 22 11:16:49.693626 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 188/374] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:49 2022] GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6 => generated 1358 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:16:50.338290 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-0330142f-3f89-4499-bd02-b3bb774c89bc tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:50.339081 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-0330142f-3f89-4499-bd02-b3bb774c89bc tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:50.348965 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-0330142f-3f89-4499-bd02-b3bb774c89bc tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:50.349256 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-0330142f-3f89-4499-bd02-b3bb774c89bc tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:50.350435 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-0330142f-3f89-4499-bd02-b3bb774c89bc tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:50.351110 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-0330142f-3f89-4499-bd02-b3bb774c89bc tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:50.474928 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-d62d0aa4-7db3-4b21-8e74-0c262831aee0 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Action: 'create', calling method: .version_select at 0x7f8445607940>, body: {"keypair": {"name": "tempest-keypair-724097415", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOJeo/gv3aNjlhAIKrwG0C+DuwqOK/ftPWzHp9qDKCaQ1D5GAsXiocPkA9sTPlFHZTZ/ty7BR/55tJKKEF1BkkqdxK7y5m4R95CCn/0kIZ44VMV05D7sKKrA79kl01vtEA=="}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:16:50.490911 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-d62d0aa4-7db3-4b21-8e74-0c262831aee0 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Getting quotas for project 601d12851417478a8b39bbf0c9fcd03d. Resources: {'key_pairs'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 22 11:16:50.495495 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-d62d0aa4-7db3-4b21-8e74-0c262831aee0 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Getting quotas for user 7c2c0270618240de8fd9290d01a7413a and project 601d12851417478a8b39bbf0c9fcd03d. Resources: {'key_pairs'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 22 11:16:50.527613 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-d62d0aa4-7db3-4b21-8e74-0c262831aee0 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.057927 Jul 22 11:16:50.529172 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 189/375] 10.222.0.20 () {60 vars in 1158 bytes} [Fri Jul 22 11:16:50 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:16:50.536949 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-c22c7091-12b6-44c9-9705-654bf24567e3 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:50.538229 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-c22c7091-12b6-44c9-9705-654bf24567e3 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: d50614d9-5b91-43b0-952b-d5ecc987e85a] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:50.546926 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-0330142f-3f89-4499-bd02-b3bb774c89bc tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:50.550647 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c22c7091-12b6-44c9-9705-654bf24567e3 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:50.551776 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c22c7091-12b6-44c9-9705-654bf24567e3 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:50.553495 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c22c7091-12b6-44c9-9705-654bf24567e3 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:50.555410 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c22c7091-12b6-44c9-9705-654bf24567e3 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:50.556575 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-0330142f-3f89-4499-bd02-b3bb774c89bc tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1721 microversion: 2.1 time: 0.225342 Jul 22 11:16:50.557635 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 187/376] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:50 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1721 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:16:50.714324 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-2779b3a0-a77b-48d6-b052-a572effafa5a tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:50.716140 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-2779b3a0-a77b-48d6-b052-a572effafa5a tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] [instance: 39fe8666-e4cc-464c-9af9-bd43835bccf6] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:50.735181 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-2779b3a0-a77b-48d6-b052-a572effafa5a tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:50.736225 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-2779b3a0-a77b-48d6-b052-a572effafa5a tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:50.738082 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-2779b3a0-a77b-48d6-b052-a572effafa5a tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:50.738909 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-2779b3a0-a77b-48d6-b052-a572effafa5a tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:50.848691 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-c22c7091-12b6-44c9-9705-654bf24567e3 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:50.862441 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-c22c7091-12b6-44c9-9705-654bf24567e3 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/d50614d9-5b91-43b0-952b-d5ecc987e85a" status: 200 len: 1367 microversion: 2.1 time: 0.331304 Jul 22 11:16:50.863573 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 190/377] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:50 2022] GET /compute/v2.1/servers/d50614d9-5b91-43b0-952b-d5ecc987e85a => generated 1367 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:16:51.096771 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-2779b3a0-a77b-48d6-b052-a572effafa5a tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e908d2b09dfc4a139d9c27f52580e15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84fa2f397c54be1b409d8be5ebc8491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:51.114732 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-2779b3a0-a77b-48d6-b052-a572effafa5a tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] 10.222.0.20 "GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6" status: 200 len: 1358 microversion: 2.1 time: 0.405774 Jul 22 11:16:51.115599 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 188/378] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:50 2022] GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6 => generated 1358 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:16:51.578282 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-86a67690-4c0e-42ff-b897-28960fae3615 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:51.579583 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-86a67690-4c0e-42ff-b897-28960fae3615 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:51.591518 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-86a67690-4c0e-42ff-b897-28960fae3615 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:51.592293 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-86a67690-4c0e-42ff-b897-28960fae3615 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:51.593664 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-86a67690-4c0e-42ff-b897-28960fae3615 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:51.594700 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-86a67690-4c0e-42ff-b897-28960fae3615 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:51.776816 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-86a67690-4c0e-42ff-b897-28960fae3615 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:51.790158 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-86a67690-4c0e-42ff-b897-28960fae3615 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1721 microversion: 2.1 time: 0.218863 Jul 22 11:16:51.791222 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 191/379] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:51 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1721 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:16:51.889047 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-7cf511d6-a3ef-49e5-9c75-f1d68dd293f0 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:51.890066 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-7cf511d6-a3ef-49e5-9c75-f1d68dd293f0 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: d50614d9-5b91-43b0-952b-d5ecc987e85a] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:51.900282 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-7cf511d6-a3ef-49e5-9c75-f1d68dd293f0 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:51.900723 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-7cf511d6-a3ef-49e5-9c75-f1d68dd293f0 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:51.901496 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-7cf511d6-a3ef-49e5-9c75-f1d68dd293f0 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:51.901922 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-7cf511d6-a3ef-49e5-9c75-f1d68dd293f0 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:51.909094 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG dbcounter [-] [117884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:16:52.142151 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-ad8d32a0-05e5-4d2a-b134-aec26812e250 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:52.143909 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-ad8d32a0-05e5-4d2a-b134-aec26812e250 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] [instance: 39fe8666-e4cc-464c-9af9-bd43835bccf6] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:52.180057 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ad8d32a0-05e5-4d2a-b134-aec26812e250 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:52.181234 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ad8d32a0-05e5-4d2a-b134-aec26812e250 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:52.182631 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ad8d32a0-05e5-4d2a-b134-aec26812e250 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:52.183135 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ad8d32a0-05e5-4d2a-b134-aec26812e250 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:52.215877 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-7cf511d6-a3ef-49e5-9c75-f1d68dd293f0 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:52.230248 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-7cf511d6-a3ef-49e5-9c75-f1d68dd293f0 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/d50614d9-5b91-43b0-952b-d5ecc987e85a" status: 200 len: 1367 microversion: 2.1 time: 0.348982 Jul 22 11:16:52.231985 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 189/380] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:51 2022] GET /compute/v2.1/servers/d50614d9-5b91-43b0-952b-d5ecc987e85a => generated 1367 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:16:52.517493 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-ad8d32a0-05e5-4d2a-b134-aec26812e250 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e908d2b09dfc4a139d9c27f52580e15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84fa2f397c54be1b409d8be5ebc8491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:52.533171 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-ad8d32a0-05e5-4d2a-b134-aec26812e250 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] 10.222.0.20 "GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6" status: 200 len: 1547 microversion: 2.1 time: 0.398153 Jul 22 11:16:52.534715 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 192/381] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:52 2022] GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6 => generated 1547 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:16:52.551295 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-bcfdb0ab-703a-4eaf-8a56-59b36d64b29f tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1318392648", "imageRef": "1a6c3cb4-9f56-44c6-aa68-01000df27209", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f4c83bdf-91ac-4a2c-a8da-a4ea4fc99527"}], "security_groups": [{"name": "tempest-securitygroup--1101625008"}], "key_name": "tempest-keypair-724097415", "user_data": "}} {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:16:52.567178 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-a45de4fd-0882-4289-bb7c-6a8d3c80de3d tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:52.569089 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-a45de4fd-0882-4289-bb7c-6a8d3c80de3d tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] [instance: 39fe8666-e4cc-464c-9af9-bd43835bccf6] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:52.585895 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a45de4fd-0882-4289-bb7c-6a8d3c80de3d tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:52.612471 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a45de4fd-0882-4289-bb7c-6a8d3c80de3d tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:52.613027 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a45de4fd-0882-4289-bb7c-6a8d3c80de3d tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:52.613473 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a45de4fd-0882-4289-bb7c-6a8d3c80de3d tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:52.772867 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.network.neutron [None req-bcfdb0ab-703a-4eaf-8a56-59b36d64b29f tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] validate_networks() for [('f4c83bdf-91ac-4a2c-a8da-a4ea4fc99527', None, None, None, None, None)] {{(pid=117884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 22 11:16:52.972820 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-a45de4fd-0882-4289-bb7c-6a8d3c80de3d tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e908d2b09dfc4a139d9c27f52580e15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84fa2f397c54be1b409d8be5ebc8491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:52.988912 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-a45de4fd-0882-4289-bb7c-6a8d3c80de3d tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] 10.222.0.20 "GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6" status: 200 len: 1547 microversion: 2.1 time: 0.427343 Jul 22 11:16:52.990915 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 193/382] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:52 2022] GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6 => generated 1547 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:16:53.016722 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-298a2d2c-8191-4bce-a469-f2ee44b30198 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:53.017609 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-298a2d2c-8191-4bce-a469-f2ee44b30198 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:53.036434 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-298a2d2c-8191-4bce-a469-f2ee44b30198 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:53.037211 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-298a2d2c-8191-4bce-a469-f2ee44b30198 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:53.038595 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-298a2d2c-8191-4bce-a469-f2ee44b30198 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:53.039705 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-298a2d2c-8191-4bce-a469-f2ee44b30198 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:53.265153 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-298a2d2c-8191-4bce-a469-f2ee44b30198 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:53.278337 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-298a2d2c-8191-4bce-a469-f2ee44b30198 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1721 microversion: 2.1 time: 0.284899 Jul 22 11:16:53.279507 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 194/383] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:52 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1721 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:16:53.289157 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-8f8c8cc3-e860-48b9-b6bd-d0fe84a6dd46 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:53.296789 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-8f8c8cc3-e860-48b9-b6bd-d0fe84a6dd46 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e908d2b09dfc4a139d9c27f52580e15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84fa2f397c54be1b409d8be5ebc8491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:53.298444 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-8f8c8cc3-e860-48b9-b6bd-d0fe84a6dd46 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Searching by: {'deleted': False, 'project_id': 'a84fa2f397c54be1b409d8be5ebc8491'} {{(pid=117885) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 22 11:16:53.307022 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8f8c8cc3-e860-48b9-b6bd-d0fe84a6dd46 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:53.307682 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8f8c8cc3-e860-48b9-b6bd-d0fe84a6dd46 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:53.308608 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8f8c8cc3-e860-48b9-b6bd-d0fe84a6dd46 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:53.309249 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8f8c8cc3-e860-48b9-b6bd-d0fe84a6dd46 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:53.464483 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.multi_cell_list [None req-8f8c8cc3-e860-48b9-b6bd-d0fe84a6dd46 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117885) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 22 11:16:53.464898 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.virt.hardware [None req-bcfdb0ab-703a-4eaf-8a56-59b36d64b29f tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Flavor limits 0:0:0 {{(pid=117884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 22 11:16:53.466134 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.virt.hardware [None req-bcfdb0ab-703a-4eaf-8a56-59b36d64b29f tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Image limits 0:0:0 {{(pid=117884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 22 11:16:53.466933 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.virt.hardware [None req-bcfdb0ab-703a-4eaf-8a56-59b36d64b29f tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Flavor pref 0:0:0 {{(pid=117884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 22 11:16:53.467671 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.virt.hardware [None req-bcfdb0ab-703a-4eaf-8a56-59b36d64b29f tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Image pref 0:0:0 {{(pid=117884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 22 11:16:53.468409 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.virt.hardware [None req-bcfdb0ab-703a-4eaf-8a56-59b36d64b29f tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 22 11:16:53.482572 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-bcfdb0ab-703a-4eaf-8a56-59b36d64b29f tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:53.483342 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-bcfdb0ab-703a-4eaf-8a56-59b36d64b29f tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:53.484670 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-bcfdb0ab-703a-4eaf-8a56-59b36d64b29f tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:53.485520 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-bcfdb0ab-703a-4eaf-8a56-59b36d64b29f tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:53.515471 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.quota [None req-bcfdb0ab-703a-4eaf-8a56-59b36d64b29f tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Getting quotas for project 601d12851417478a8b39bbf0c9fcd03d. Resources: {'instances', 'cores', 'ram'} {{(pid=117884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 22 11:16:53.522369 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.quota [None req-bcfdb0ab-703a-4eaf-8a56-59b36d64b29f tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Getting quotas for user 7c2c0270618240de8fd9290d01a7413a and project 601d12851417478a8b39bbf0c9fcd03d. Resources: {'instances', 'cores', 'ram'} {{(pid=117884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 22 11:16:53.541079 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-bcfdb0ab-703a-4eaf-8a56-59b36d64b29f tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Going to run 1 instances... {{(pid=117884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 22 11:16:53.544945 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-bcfdb0ab-703a-4eaf-8a56-59b36d64b29f tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 6d50352a-fd4f-4ca5-8e13-2519dfbb66a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1a6c3cb4-9f56-44c6-aa68-01000df27209',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 22 11:16:53.630523 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-bcfdb0ab-703a-4eaf-8a56-59b36d64b29f tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.083642 Jul 22 11:16:53.631627 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 190/384] 10.222.0.20 () {60 vars in 1146 bytes} [Fri Jul 22 11:16:52 2022] POST /compute/v2.1/servers => generated 409 bytes in 1086 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 22 11:16:53.643200 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-d7a90ded-37a6-4def-bb8a-02aeb84a06df tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:53.644540 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-d7a90ded-37a6-4def-bb8a-02aeb84a06df tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: d50614d9-5b91-43b0-952b-d5ecc987e85a] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:53.645848 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-8f8c8cc3-e860-48b9-b6bd-d0fe84a6dd46 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.364521 Jul 22 11:16:53.654255 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 195/385] 10.222.0.20 () {58 vars in 1124 bytes} [Fri Jul 22 11:16:53 2022] GET /compute/v2.1/servers => generated 343 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:16:53.657452 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-b3cf07c0-7f97-4e94-957c-758ce0d80a1e tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:53.658744 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-b3cf07c0-7f97-4e94-957c-758ce0d80a1e tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 6d50352a-fd4f-4ca5-8e13-2519dfbb66a1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:53.661490 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-d7a90ded-37a6-4def-bb8a-02aeb84a06df tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:53.661935 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-d7a90ded-37a6-4def-bb8a-02aeb84a06df tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:53.662885 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-d7a90ded-37a6-4def-bb8a-02aeb84a06df tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:53.663342 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-d7a90ded-37a6-4def-bb8a-02aeb84a06df tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:53.734140 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-b3cf07c0-7f97-4e94-957c-758ce0d80a1e tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:53.747917 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-b3cf07c0-7f97-4e94-957c-758ce0d80a1e tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1" status: 200 len: 1245 microversion: 2.1 time: 0.099081 Jul 22 11:16:53.750399 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 196/386] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:53 2022] GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1 => generated 1245 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:16:53.757199 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-f5cf341d-f767-42f2-97fc-8ddf2a177437 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:53.757983 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-f5cf341d-f767-42f2-97fc-8ddf2a177437 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] [instance: 39fe8666-e4cc-464c-9af9-bd43835bccf6] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:53.768027 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f5cf341d-f767-42f2-97fc-8ddf2a177437 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:53.768485 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f5cf341d-f767-42f2-97fc-8ddf2a177437 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:53.769277 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f5cf341d-f767-42f2-97fc-8ddf2a177437 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:53.769867 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f5cf341d-f767-42f2-97fc-8ddf2a177437 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:53.856883 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-d7a90ded-37a6-4def-bb8a-02aeb84a06df tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:53.870945 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-d7a90ded-37a6-4def-bb8a-02aeb84a06df tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/d50614d9-5b91-43b0-952b-d5ecc987e85a" status: 200 len: 1367 microversion: 2.1 time: 0.237616 Jul 22 11:16:53.882070 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 191/387] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:53 2022] GET /compute/v2.1/servers/d50614d9-5b91-43b0-952b-d5ecc987e85a => generated 1367 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:16:53.952728 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-f5cf341d-f767-42f2-97fc-8ddf2a177437 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e908d2b09dfc4a139d9c27f52580e15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84fa2f397c54be1b409d8be5ebc8491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:53.963507 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-f5cf341d-f767-42f2-97fc-8ddf2a177437 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] 10.222.0.20 "GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6" status: 200 len: 1547 microversion: 2.1 time: 0.210930 Jul 22 11:16:53.964370 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 197/388] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:53 2022] GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6 => generated 1547 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:16:54.308717 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-8ff55567-e008-4d1b-aa21-358ee75b715f tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:54.309463 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-8ff55567-e008-4d1b-aa21-358ee75b715f tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:54.323132 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-8ff55567-e008-4d1b-aa21-358ee75b715f tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:54.323827 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-8ff55567-e008-4d1b-aa21-358ee75b715f tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:54.324805 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-8ff55567-e008-4d1b-aa21-358ee75b715f tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:54.328144 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-8ff55567-e008-4d1b-aa21-358ee75b715f tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:54.547139 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-8ff55567-e008-4d1b-aa21-358ee75b715f tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:54.557823 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-8ff55567-e008-4d1b-aa21-358ee75b715f tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1721 microversion: 2.1 time: 0.256227 Jul 22 11:16:54.559104 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 192/389] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:54 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1721 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:16:54.610693 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-50204753-5a14-4da7-9bfb-7a31d42e91a5 req-d74fd116-0d6b-4b31-a22c-67d4d134d3f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d50614d9-5b91-43b0-952b-d5ecc987e85a", "name": "network-vif-plugged", "status": "completed", "tag": "2f780c3c-9237-4cac-b261-2b6b1e51cc1b"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:16:54.620407 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-50204753-5a14-4da7-9bfb-7a31d42e91a5 req-d74fd116-0d6b-4b31-a22c-67d4d134d3f7 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:54.623145 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-50204753-5a14-4da7-9bfb-7a31d42e91a5 req-d74fd116-0d6b-4b31-a22c-67d4d134d3f7 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:54.632895 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-50204753-5a14-4da7-9bfb-7a31d42e91a5 req-d74fd116-0d6b-4b31-a22c-67d4d134d3f7 service nova] Creating event network-vif-plugged:2f780c3c-9237-4cac-b261-2b6b1e51cc1b for instance d50614d9-5b91-43b0-952b-d5ecc987e85a on hv-cinder-84890 Jul 22 11:16:54.640596 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-50204753-5a14-4da7-9bfb-7a31d42e91a5 req-d74fd116-0d6b-4b31-a22c-67d4d134d3f7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033741 Jul 22 11:16:54.641219 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 198/390] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:16:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:16:54.769415 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-5ee5dfee-ba79-4c92-8b0b-93b746a16c4f tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:54.770033 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-5ee5dfee-ba79-4c92-8b0b-93b746a16c4f tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 6d50352a-fd4f-4ca5-8e13-2519dfbb66a1] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:54.776509 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-5ee5dfee-ba79-4c92-8b0b-93b746a16c4f tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:54.777010 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-5ee5dfee-ba79-4c92-8b0b-93b746a16c4f tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:54.778376 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-5ee5dfee-ba79-4c92-8b0b-93b746a16c4f tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:54.778818 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-5ee5dfee-ba79-4c92-8b0b-93b746a16c4f tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:54.873942 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-5ee5dfee-ba79-4c92-8b0b-93b746a16c4f tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:54.884831 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-5ee5dfee-ba79-4c92-8b0b-93b746a16c4f tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1" status: 200 len: 1297 microversion: 2.1 time: 0.119243 Jul 22 11:16:54.885453 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 193/391] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:54 2022] GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1 => generated 1297 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:16:54.891896 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-e4658f0c-8384-4b12-aa9d-de15ae2f7587 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:54.892969 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-e4658f0c-8384-4b12-aa9d-de15ae2f7587 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: d50614d9-5b91-43b0-952b-d5ecc987e85a] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:54.901306 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e4658f0c-8384-4b12-aa9d-de15ae2f7587 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:54.902018 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e4658f0c-8384-4b12-aa9d-de15ae2f7587 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:54.903641 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e4658f0c-8384-4b12-aa9d-de15ae2f7587 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:54.904231 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e4658f0c-8384-4b12-aa9d-de15ae2f7587 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:55.058283 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-e4658f0c-8384-4b12-aa9d-de15ae2f7587 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:55.073936 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-e4658f0c-8384-4b12-aa9d-de15ae2f7587 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/d50614d9-5b91-43b0-952b-d5ecc987e85a" status: 200 len: 1367 microversion: 2.1 time: 0.186780 Jul 22 11:16:55.076015 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 199/392] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:54 2022] GET /compute/v2.1/servers/d50614d9-5b91-43b0-952b-d5ecc987e85a => generated 1367 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:16:55.581766 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-f393644d-7aeb-486b-90cb-65a80aaca590 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:55.582683 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-f393644d-7aeb-486b-90cb-65a80aaca590 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:55.589615 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f393644d-7aeb-486b-90cb-65a80aaca590 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:55.590644 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f393644d-7aeb-486b-90cb-65a80aaca590 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:55.591627 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f393644d-7aeb-486b-90cb-65a80aaca590 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:55.592138 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f393644d-7aeb-486b-90cb-65a80aaca590 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:55.812241 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-f393644d-7aeb-486b-90cb-65a80aaca590 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:55.829056 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-f393644d-7aeb-486b-90cb-65a80aaca590 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1721 microversion: 2.1 time: 0.253148 Jul 22 11:16:55.830052 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 194/393] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:55 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1721 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:16:55.851205 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-86fa1b4f-6cc6-4b6d-b7c9-149fb3452526 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7333057c-1797-468b-9675-2d22a5216d07"}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:16:55.853329 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-86fa1b4f-6cc6-4b6d-b7c9-149fb3452526 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] [instance: 39fe8666-e4cc-464c-9af9-bd43835bccf6] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:55.861852 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-86fa1b4f-6cc6-4b6d-b7c9-149fb3452526 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:55.862298 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-86fa1b4f-6cc6-4b6d-b7c9-149fb3452526 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:55.863250 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-86fa1b4f-6cc6-4b6d-b7c9-149fb3452526 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:55.863722 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-86fa1b4f-6cc6-4b6d-b7c9-149fb3452526 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:55.911035 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-c541f4da-1905-45de-9850-dca9cc772131 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:55.912118 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-c541f4da-1905-45de-9850-dca9cc772131 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 6d50352a-fd4f-4ca5-8e13-2519dfbb66a1] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:55.919544 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c541f4da-1905-45de-9850-dca9cc772131 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:55.919986 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c541f4da-1905-45de-9850-dca9cc772131 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:55.920967 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c541f4da-1905-45de-9850-dca9cc772131 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:55.921450 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c541f4da-1905-45de-9850-dca9cc772131 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:56.024207 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-c541f4da-1905-45de-9850-dca9cc772131 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:56.038048 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-c541f4da-1905-45de-9850-dca9cc772131 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1" status: 200 len: 1303 microversion: 2.1 time: 0.130571 Jul 22 11:16:56.039059 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 195/394] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:55 2022] GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1 => generated 1303 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:16:56.104402 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-fc1c8876-f0d2-4876-b56b-f9b413ee69da tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:56.105368 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-fc1c8876-f0d2-4876-b56b-f9b413ee69da tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: d50614d9-5b91-43b0-952b-d5ecc987e85a] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:56.115187 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-fc1c8876-f0d2-4876-b56b-f9b413ee69da tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:56.116011 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-fc1c8876-f0d2-4876-b56b-f9b413ee69da tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:56.117117 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-fc1c8876-f0d2-4876-b56b-f9b413ee69da tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:56.118202 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-fc1c8876-f0d2-4876-b56b-f9b413ee69da tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:56.296450 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-fc1c8876-f0d2-4876-b56b-f9b413ee69da tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:56.310877 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-fc1c8876-f0d2-4876-b56b-f9b413ee69da tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/d50614d9-5b91-43b0-952b-d5ecc987e85a" status: 200 len: 1367 microversion: 2.1 time: 0.213246 Jul 22 11:16:56.312137 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 196/395] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:56 2022] GET /compute/v2.1/servers/d50614d9-5b91-43b0-952b-d5ecc987e85a => generated 1367 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:16:56.822919 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-86fa1b4f-6cc6-4b6d-b7c9-149fb3452526 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] 10.222.0.20 "POST /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.976026 Jul 22 11:16:56.828657 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 200/396] 10.222.0.20 () {60 vars in 1322 bytes} [Fri Jul 22 11:16:55 2022] POST /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6/os-volume_attachments => generated 194 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 22 11:16:56.848310 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-8db61909-4293-474f-bb38-ce80302608f3 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:56.850525 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-8db61909-4293-474f-bb38-ce80302608f3 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:56.871237 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG dbcounter [-] [117884] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:16:56.877106 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-8db61909-4293-474f-bb38-ce80302608f3 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:56.879520 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-8db61909-4293-474f-bb38-ce80302608f3 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:56.881739 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-8db61909-4293-474f-bb38-ce80302608f3 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:56.887292 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-8db61909-4293-474f-bb38-ce80302608f3 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:57.065993 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-77517534-8849-4144-b200-1f9ee8b554d1 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:57.068888 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-77517534-8849-4144-b200-1f9ee8b554d1 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 6d50352a-fd4f-4ca5-8e13-2519dfbb66a1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:57.093654 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-77517534-8849-4144-b200-1f9ee8b554d1 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:57.097364 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-77517534-8849-4144-b200-1f9ee8b554d1 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:57.099932 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-77517534-8849-4144-b200-1f9ee8b554d1 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:57.101339 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-77517534-8849-4144-b200-1f9ee8b554d1 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:57.233798 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-8db61909-4293-474f-bb38-ce80302608f3 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:57.248705 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-8db61909-4293-474f-bb38-ce80302608f3 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1721 microversion: 2.1 time: 0.404810 Jul 22 11:16:57.250036 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 197/397] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:56 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1721 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:16:57.343814 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-ba3e4a9f-181a-47e0-974d-3007f49dcf52 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:57.344940 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-ba3e4a9f-181a-47e0-974d-3007f49dcf52 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: d50614d9-5b91-43b0-952b-d5ecc987e85a] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:57.357872 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-ba3e4a9f-181a-47e0-974d-3007f49dcf52 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:57.359149 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-ba3e4a9f-181a-47e0-974d-3007f49dcf52 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:57.361004 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-ba3e4a9f-181a-47e0-974d-3007f49dcf52 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:57.361978 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-ba3e4a9f-181a-47e0-974d-3007f49dcf52 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:57.533488 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-77517534-8849-4144-b200-1f9ee8b554d1 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:57.543458 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-77517534-8849-4144-b200-1f9ee8b554d1 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1" status: 200 len: 1371 microversion: 2.1 time: 0.490254 Jul 22 11:16:57.552596 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 201/398] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:57 2022] GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1 => generated 1371 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:16:57.576837 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-ba3e4a9f-181a-47e0-974d-3007f49dcf52 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:57.587355 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-ba3e4a9f-181a-47e0-974d-3007f49dcf52 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/d50614d9-5b91-43b0-952b-d5ecc987e85a" status: 200 len: 1558 microversion: 2.1 time: 0.251706 Jul 22 11:16:57.588193 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 198/399] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:57 2022] GET /compute/v2.1/servers/d50614d9-5b91-43b0-952b-d5ecc987e85a => generated 1558 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:16:57.607068 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-140e1a33-84d8-4863-9c67-0604eead39d3 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:57.608245 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-140e1a33-84d8-4863-9c67-0604eead39d3 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: d50614d9-5b91-43b0-952b-d5ecc987e85a] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:57.618337 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-140e1a33-84d8-4863-9c67-0604eead39d3 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:57.618873 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-140e1a33-84d8-4863-9c67-0604eead39d3 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:57.619779 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-140e1a33-84d8-4863-9c67-0604eead39d3 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:57.620273 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-140e1a33-84d8-4863-9c67-0604eead39d3 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:57.639314 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:16:57.750127 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-140e1a33-84d8-4863-9c67-0604eead39d3 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/d50614d9-5b91-43b0-952b-d5ecc987e85a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.147990 Jul 22 11:16:57.750965 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 202/400] 10.222.0.20 () {58 vars in 1274 bytes} [Fri Jul 22 11:16:57 2022] GET /compute/v2.1/servers/d50614d9-5b91-43b0-952b-d5ecc987e85a/os-interface => generated 285 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:16:58.218707 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [req-d5ebbb47-876b-465a-b78e-080da8f259cd req-46e9a5b6-4be4-40b5-a8ff-62174a1c70a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d50352a-fd4f-4ca5-8e13-2519dfbb66a1", "tag": "fa52f10e-8382-40d6-8633-f6bcf76980e8"}]} {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:16:58.243002 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-d5ebbb47-876b-465a-b78e-080da8f259cd req-46e9a5b6-4be4-40b5-a8ff-62174a1c70a0 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:58.244163 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-d5ebbb47-876b-465a-b78e-080da8f259cd req-46e9a5b6-4be4-40b5-a8ff-62174a1c70a0 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:58.267219 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.compute.server_external_events [req-d5ebbb47-876b-465a-b78e-080da8f259cd req-46e9a5b6-4be4-40b5-a8ff-62174a1c70a0 service nova] Creating event network-changed:fa52f10e-8382-40d6-8633-f6bcf76980e8 for instance 6d50352a-fd4f-4ca5-8e13-2519dfbb66a1 on hv-cinder-84890 Jul 22 11:16:58.268415 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-9c02979a-8ea6-4c51-a690-5fb0660f5589 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:58.269687 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-9c02979a-8ea6-4c51-a690-5fb0660f5589 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:58.279961 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [req-d5ebbb47-876b-465a-b78e-080da8f259cd req-46e9a5b6-4be4-40b5-a8ff-62174a1c70a0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074974 Jul 22 11:16:58.281078 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9c02979a-8ea6-4c51-a690-5fb0660f5589 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:58.281807 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9c02979a-8ea6-4c51-a690-5fb0660f5589 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:58.282622 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 199/401] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:16:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:16:58.283607 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9c02979a-8ea6-4c51-a690-5fb0660f5589 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:58.284208 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9c02979a-8ea6-4c51-a690-5fb0660f5589 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:58.558434 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-9c02979a-8ea6-4c51-a690-5fb0660f5589 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:58.570227 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-9c02979a-8ea6-4c51-a690-5fb0660f5589 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1721 microversion: 2.1 time: 0.308059 Jul 22 11:16:58.572648 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 203/402] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:58 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1721 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:16:58.577298 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-76d483cb-f2e0-4bc8-92eb-72306f3371f9 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:58.578571 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-76d483cb-f2e0-4bc8-92eb-72306f3371f9 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 6d50352a-fd4f-4ca5-8e13-2519dfbb66a1] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:58.592655 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-76d483cb-f2e0-4bc8-92eb-72306f3371f9 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:58.593769 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-76d483cb-f2e0-4bc8-92eb-72306f3371f9 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:58.596412 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-76d483cb-f2e0-4bc8-92eb-72306f3371f9 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:58.597596 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-76d483cb-f2e0-4bc8-92eb-72306f3371f9 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:59.437314 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-76d483cb-f2e0-4bc8-92eb-72306f3371f9 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:59.446609 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-76d483cb-f2e0-4bc8-92eb-72306f3371f9 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1" status: 200 len: 1371 microversion: 2.1 time: 0.886223 Jul 22 11:16:59.447207 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 200/403] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:58 2022] GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1 => generated 1371 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:16:59.600219 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-a8224f5e-8934-468d-b659-a0d8394893e2 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:16:59.601153 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-a8224f5e-8934-468d-b659-a0d8394893e2 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:16:59.613113 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a8224f5e-8934-468d-b659-a0d8394893e2 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:59.614014 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a8224f5e-8934-468d-b659-a0d8394893e2 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:59.615852 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a8224f5e-8934-468d-b659-a0d8394893e2 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:16:59.616630 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a8224f5e-8934-468d-b659-a0d8394893e2 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:16:59.806333 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-a8224f5e-8934-468d-b659-a0d8394893e2 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:16:59.820401 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-a8224f5e-8934-468d-b659-a0d8394893e2 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1721 microversion: 2.1 time: 0.228174 Jul 22 11:16:59.821146 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 204/404] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:16:59 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1721 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:17:00.089104 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [req-60b34f4a-0cfb-4d78-b3cb-9d45756e290e req-2fee8711-352d-44df-b6e4-d0009d9ee4eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d50614d9-5b91-43b0-952b-d5ecc987e85a", "tag": "2f780c3c-9237-4cac-b261-2b6b1e51cc1b"}]} {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:17:00.103697 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-60b34f4a-0cfb-4d78-b3cb-9d45756e290e req-2fee8711-352d-44df-b6e4-d0009d9ee4eb service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:00.104732 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-60b34f4a-0cfb-4d78-b3cb-9d45756e290e req-2fee8711-352d-44df-b6e4-d0009d9ee4eb service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:00.123200 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.compute.server_external_events [req-60b34f4a-0cfb-4d78-b3cb-9d45756e290e req-2fee8711-352d-44df-b6e4-d0009d9ee4eb service nova] Creating event network-changed:2f780c3c-9237-4cac-b261-2b6b1e51cc1b for instance d50614d9-5b91-43b0-952b-d5ecc987e85a on hv-cinder-84890 Jul 22 11:17:00.128758 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [req-60b34f4a-0cfb-4d78-b3cb-9d45756e290e req-2fee8711-352d-44df-b6e4-d0009d9ee4eb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048233 Jul 22 11:17:00.129422 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 201/405] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:17:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:17:00.472037 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-0a797e49-c973-496b-970e-971c6ae49fc7 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:17:00.472652 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-0a797e49-c973-496b-970e-971c6ae49fc7 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 6d50352a-fd4f-4ca5-8e13-2519dfbb66a1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:17:00.481569 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0a797e49-c973-496b-970e-971c6ae49fc7 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:00.482021 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0a797e49-c973-496b-970e-971c6ae49fc7 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:00.482806 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0a797e49-c973-496b-970e-971c6ae49fc7 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:00.483242 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0a797e49-c973-496b-970e-971c6ae49fc7 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:00.691811 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-0a797e49-c973-496b-970e-971c6ae49fc7 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:17:00.706126 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-0a797e49-c973-496b-970e-971c6ae49fc7 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1" status: 200 len: 1371 microversion: 2.1 time: 0.238026 Jul 22 11:17:00.707175 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 205/406] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:17:00 2022] GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1 => generated 1371 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:17:00.852132 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-af9593e3-b0f1-49b8-a551-8a82a9048adb tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:17:00.853294 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-af9593e3-b0f1-49b8-a551-8a82a9048adb tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:17:00.865429 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-af9593e3-b0f1-49b8-a551-8a82a9048adb tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:00.866220 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-af9593e3-b0f1-49b8-a551-8a82a9048adb tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:00.867587 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-af9593e3-b0f1-49b8-a551-8a82a9048adb tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:00.868344 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-af9593e3-b0f1-49b8-a551-8a82a9048adb tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:01.061025 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-af9593e3-b0f1-49b8-a551-8a82a9048adb tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:17:01.069714 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-af9593e3-b0f1-49b8-a551-8a82a9048adb tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1721 microversion: 2.1 time: 0.225954 Jul 22 11:17:01.070577 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 202/407] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:17:00 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1721 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:17:01.731444 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-a2eb662d-2f15-44f4-a5de-05133f7ba045 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:17:01.732056 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-a2eb662d-2f15-44f4-a5de-05133f7ba045 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 6d50352a-fd4f-4ca5-8e13-2519dfbb66a1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:17:01.738824 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a2eb662d-2f15-44f4-a5de-05133f7ba045 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:01.739538 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a2eb662d-2f15-44f4-a5de-05133f7ba045 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:01.740319 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a2eb662d-2f15-44f4-a5de-05133f7ba045 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:01.740755 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a2eb662d-2f15-44f4-a5de-05133f7ba045 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:01.897420 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-a2eb662d-2f15-44f4-a5de-05133f7ba045 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:17:01.906051 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-a2eb662d-2f15-44f4-a5de-05133f7ba045 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1" status: 200 len: 1371 microversion: 2.1 time: 0.178531 Jul 22 11:17:01.906786 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 206/408] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:17:01 2022] GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1 => generated 1371 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:17:02.094673 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-1e61f2ec-b7df-46c9-882a-6495d7fb402b tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:17:02.097507 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-1e61f2ec-b7df-46c9-882a-6495d7fb402b tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:17:02.102131 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-1e61f2ec-b7df-46c9-882a-6495d7fb402b tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:02.102583 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-1e61f2ec-b7df-46c9-882a-6495d7fb402b tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:02.103415 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-1e61f2ec-b7df-46c9-882a-6495d7fb402b tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:02.103859 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-1e61f2ec-b7df-46c9-882a-6495d7fb402b tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:02.283402 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-1e61f2ec-b7df-46c9-882a-6495d7fb402b tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:17:02.291931 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-1e61f2ec-b7df-46c9-882a-6495d7fb402b tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1721 microversion: 2.1 time: 0.202239 Jul 22 11:17:02.292824 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 203/409] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:17:02 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1721 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:17:02.928199 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-d31136b4-2599-41b1-9d82-5f19a0095499 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:17:02.929264 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-d31136b4-2599-41b1-9d82-5f19a0095499 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 6d50352a-fd4f-4ca5-8e13-2519dfbb66a1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:17:02.939341 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d31136b4-2599-41b1-9d82-5f19a0095499 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:02.939800 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d31136b4-2599-41b1-9d82-5f19a0095499 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:02.940593 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d31136b4-2599-41b1-9d82-5f19a0095499 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:02.941031 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d31136b4-2599-41b1-9d82-5f19a0095499 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:03.143567 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-d31136b4-2599-41b1-9d82-5f19a0095499 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:17:03.157223 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-d31136b4-2599-41b1-9d82-5f19a0095499 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1" status: 200 len: 1371 microversion: 2.1 time: 0.236308 Jul 22 11:17:03.158246 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 207/410] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:17:02 2022] GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1 => generated 1371 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:17:03.312231 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-627a532a-946d-4ada-8557-7a7a4ac01ea9 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:17:03.313652 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-627a532a-946d-4ada-8557-7a7a4ac01ea9 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:17:03.321922 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-627a532a-946d-4ada-8557-7a7a4ac01ea9 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:03.322605 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-627a532a-946d-4ada-8557-7a7a4ac01ea9 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:03.323755 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-627a532a-946d-4ada-8557-7a7a4ac01ea9 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:03.324933 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-627a532a-946d-4ada-8557-7a7a4ac01ea9 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:03.498098 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG dbcounter [-] [117884] Writing DB stats nova_cell0:SELECT=2 {{(pid=117884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:17:03.534311 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG dbcounter [-] [117884] Writing DB stats nova_cell0:SELECT=6 {{(pid=117884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:17:03.751448 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-627a532a-946d-4ada-8557-7a7a4ac01ea9 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:17:03.771506 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-627a532a-946d-4ada-8557-7a7a4ac01ea9 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1721 microversion: 2.1 time: 0.462904 Jul 22 11:17:03.772942 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 204/411] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:17:03 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1721 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:17:04.182580 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-733a3709-4825-4fab-88e6-a486dce86ea9 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:17:04.183520 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-733a3709-4825-4fab-88e6-a486dce86ea9 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 6d50352a-fd4f-4ca5-8e13-2519dfbb66a1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:17:04.185478 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell0:SELECT=2 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:17:04.186214 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell0:SELECT=6 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:17:04.194023 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-733a3709-4825-4fab-88e6-a486dce86ea9 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:04.194702 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-733a3709-4825-4fab-88e6-a486dce86ea9 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:04.195572 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-733a3709-4825-4fab-88e6-a486dce86ea9 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:04.196045 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-733a3709-4825-4fab-88e6-a486dce86ea9 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:04.391111 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-733a3709-4825-4fab-88e6-a486dce86ea9 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:17:04.405862 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-733a3709-4825-4fab-88e6-a486dce86ea9 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1" status: 200 len: 1371 microversion: 2.1 time: 0.226945 Jul 22 11:17:04.406609 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 208/412] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:17:04 2022] GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1 => generated 1371 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:17:04.802912 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-5d9c502d-d6a1-4ff6-9d8c-ebc088fe795d tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:17:04.804223 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-5d9c502d-d6a1-4ff6-9d8c-ebc088fe795d tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:17:04.812507 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-5d9c502d-d6a1-4ff6-9d8c-ebc088fe795d tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:04.813399 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-5d9c502d-d6a1-4ff6-9d8c-ebc088fe795d tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:04.814828 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-5d9c502d-d6a1-4ff6-9d8c-ebc088fe795d tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:04.815595 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-5d9c502d-d6a1-4ff6-9d8c-ebc088fe795d tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:05.016218 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-5d9c502d-d6a1-4ff6-9d8c-ebc088fe795d tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:17:05.032732 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-5d9c502d-d6a1-4ff6-9d8c-ebc088fe795d tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1721 microversion: 2.1 time: 0.234073 Jul 22 11:17:05.034652 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 205/413] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:17:04 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1721 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:17:05.436880 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-34d242aa-2850-491b-bb97-4d8ab3155bb0 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:17:05.437919 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-34d242aa-2850-491b-bb97-4d8ab3155bb0 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 6d50352a-fd4f-4ca5-8e13-2519dfbb66a1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:17:05.445889 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-34d242aa-2850-491b-bb97-4d8ab3155bb0 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:05.446399 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-34d242aa-2850-491b-bb97-4d8ab3155bb0 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:05.447854 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-34d242aa-2850-491b-bb97-4d8ab3155bb0 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:05.448633 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-34d242aa-2850-491b-bb97-4d8ab3155bb0 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:05.685542 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-34d242aa-2850-491b-bb97-4d8ab3155bb0 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:17:05.700313 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-34d242aa-2850-491b-bb97-4d8ab3155bb0 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1" status: 200 len: 1371 microversion: 2.1 time: 0.270340 Jul 22 11:17:05.700751 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 209/414] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:17:05 2022] GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1 => generated 1371 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:17:06.067865 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-e3566e8a-1bcb-4c5a-b478-f9543be8339d tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:17:06.068880 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-e3566e8a-1bcb-4c5a-b478-f9543be8339d tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:17:06.080554 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-e3566e8a-1bcb-4c5a-b478-f9543be8339d tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:06.081265 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-e3566e8a-1bcb-4c5a-b478-f9543be8339d tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:06.082610 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-e3566e8a-1bcb-4c5a-b478-f9543be8339d tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:06.083457 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-e3566e8a-1bcb-4c5a-b478-f9543be8339d tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:06.294503 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-e3566e8a-1bcb-4c5a-b478-f9543be8339d tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:17:06.312640 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-e3566e8a-1bcb-4c5a-b478-f9543be8339d tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1721 microversion: 2.1 time: 0.252610 Jul 22 11:17:06.313672 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 206/415] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:17:06 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1721 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:17:06.723202 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-8eee9149-932c-4cac-a9b7-0302389be8a1 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:17:06.724487 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-8eee9149-932c-4cac-a9b7-0302389be8a1 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 6d50352a-fd4f-4ca5-8e13-2519dfbb66a1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:17:06.731277 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8eee9149-932c-4cac-a9b7-0302389be8a1 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:06.731860 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8eee9149-932c-4cac-a9b7-0302389be8a1 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:06.733197 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8eee9149-932c-4cac-a9b7-0302389be8a1 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:06.734020 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8eee9149-932c-4cac-a9b7-0302389be8a1 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:06.801866 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [req-d3b1dcd8-c94e-47f3-b250-fadba2a2d45c req-d4e1caf1-4ddd-4811-aad1-b157774351ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d50352a-fd4f-4ca5-8e13-2519dfbb66a1", "name": "network-vif-plugged", "status": "completed", "tag": "fa52f10e-8382-40d6-8633-f6bcf76980e8"}]} {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:17:06.825123 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-d3b1dcd8-c94e-47f3-b250-fadba2a2d45c req-d4e1caf1-4ddd-4811-aad1-b157774351ea service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:06.826058 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-d3b1dcd8-c94e-47f3-b250-fadba2a2d45c req-d4e1caf1-4ddd-4811-aad1-b157774351ea service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:06.847659 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.compute.server_external_events [req-d3b1dcd8-c94e-47f3-b250-fadba2a2d45c req-d4e1caf1-4ddd-4811-aad1-b157774351ea service nova] Creating event network-vif-plugged:fa52f10e-8382-40d6-8633-f6bcf76980e8 for instance 6d50352a-fd4f-4ca5-8e13-2519dfbb66a1 on hv-cinder-84890 Jul 22 11:17:06.860309 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [req-d3b1dcd8-c94e-47f3-b250-fadba2a2d45c req-d4e1caf1-4ddd-4811-aad1-b157774351ea service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064127 Jul 22 11:17:06.862292 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 207/416] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:17:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:17:06.938219 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-8eee9149-932c-4cac-a9b7-0302389be8a1 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:17:06.952913 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-8eee9149-932c-4cac-a9b7-0302389be8a1 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1" status: 200 len: 1371 microversion: 2.1 time: 0.233891 Jul 22 11:17:06.968122 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 210/417] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:17:06 2022] GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1 => generated 1371 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:17:07.136029 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-6e6514cb-245e-4d08-9c4d-6d1355db42d8 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:17:07.137796 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-6e6514cb-245e-4d08-9c4d-6d1355db42d8 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] [instance: 39fe8666-e4cc-464c-9af9-bd43835bccf6] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:17:07.147798 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-6e6514cb-245e-4d08-9c4d-6d1355db42d8 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:07.148418 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-6e6514cb-245e-4d08-9c4d-6d1355db42d8 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:07.149603 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-6e6514cb-245e-4d08-9c4d-6d1355db42d8 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:07.150250 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-6e6514cb-245e-4d08-9c4d-6d1355db42d8 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:07.168849 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG dbcounter [-] [117884] Writing DB stats nova_cell1:SELECT=100 {{(pid=117884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:17:07.340885 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-a82dbab8-0a72-404e-90be-099f3c5a555d tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:17:07.341977 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-a82dbab8-0a72-404e-90be-099f3c5a555d tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:17:07.351325 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a82dbab8-0a72-404e-90be-099f3c5a555d tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:07.352044 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a82dbab8-0a72-404e-90be-099f3c5a555d tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:07.353399 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a82dbab8-0a72-404e-90be-099f3c5a555d tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:07.354153 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a82dbab8-0a72-404e-90be-099f3c5a555d tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:07.388899 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-6e6514cb-245e-4d08-9c4d-6d1355db42d8 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e908d2b09dfc4a139d9c27f52580e15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84fa2f397c54be1b409d8be5ebc8491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:17:07.398508 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-6e6514cb-245e-4d08-9c4d-6d1355db42d8 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] 10.222.0.20 "GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6" status: 200 len: 1593 microversion: 2.1 time: 0.269855 Jul 22 11:17:07.399600 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 208/418] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:17:07 2022] GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6 => generated 1593 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:17:07.575834 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-a82dbab8-0a72-404e-90be-099f3c5a555d tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:17:07.590478 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-a82dbab8-0a72-404e-90be-099f3c5a555d tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1721 microversion: 2.1 time: 0.256645 Jul 22 11:17:07.592914 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 211/419] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:17:07 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1721 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:17:07.979377 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-47c96989-1f84-4f38-952c-369d06ef15e4 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:17:07.981025 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-47c96989-1f84-4f38-952c-369d06ef15e4 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 6d50352a-fd4f-4ca5-8e13-2519dfbb66a1] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:17:07.990134 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-47c96989-1f84-4f38-952c-369d06ef15e4 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:07.990413 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-47c96989-1f84-4f38-952c-369d06ef15e4 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:07.991109 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-47c96989-1f84-4f38-952c-369d06ef15e4 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:07.991597 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-47c96989-1f84-4f38-952c-369d06ef15e4 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:08.275320 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-47c96989-1f84-4f38-952c-369d06ef15e4 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:17:08.288659 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-47c96989-1f84-4f38-952c-369d06ef15e4 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1" status: 200 len: 1371 microversion: 2.1 time: 0.313519 Jul 22 11:17:08.291673 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 209/420] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:17:07 2022] GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1 => generated 1371 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:17:08.622534 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-ccdd4f2d-c536-4360-8709-9cda8ff71845 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:17:08.624021 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-ccdd4f2d-c536-4360-8709-9cda8ff71845 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:17:08.635775 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ccdd4f2d-c536-4360-8709-9cda8ff71845 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:08.637482 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ccdd4f2d-c536-4360-8709-9cda8ff71845 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:08.639219 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ccdd4f2d-c536-4360-8709-9cda8ff71845 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:08.640440 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ccdd4f2d-c536-4360-8709-9cda8ff71845 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:08.866290 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-ccdd4f2d-c536-4360-8709-9cda8ff71845 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:17:08.885976 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-ccdd4f2d-c536-4360-8709-9cda8ff71845 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1721 microversion: 2.1 time: 0.270845 Jul 22 11:17:08.887701 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 212/421] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:17:08 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1721 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:17:09.319999 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-26ded2ef-5e9c-447e-888b-980e78faf7c7 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:17:09.320739 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-26ded2ef-5e9c-447e-888b-980e78faf7c7 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 6d50352a-fd4f-4ca5-8e13-2519dfbb66a1] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:17:09.330741 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-26ded2ef-5e9c-447e-888b-980e78faf7c7 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:09.331312 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-26ded2ef-5e9c-447e-888b-980e78faf7c7 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:09.332750 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-26ded2ef-5e9c-447e-888b-980e78faf7c7 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:09.333544 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-26ded2ef-5e9c-447e-888b-980e78faf7c7 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:09.911028 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-83d76b7f-9f94-4fa4-97fb-f5f122ece884 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:17:09.911992 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-83d76b7f-9f94-4fa4-97fb-f5f122ece884 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:17:09.917172 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=1 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:17:09.923454 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-83d76b7f-9f94-4fa4-97fb-f5f122ece884 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:09.923911 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-83d76b7f-9f94-4fa4-97fb-f5f122ece884 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:09.924719 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-83d76b7f-9f94-4fa4-97fb-f5f122ece884 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:09.925158 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-83d76b7f-9f94-4fa4-97fb-f5f122ece884 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:09.992755 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-26ded2ef-5e9c-447e-888b-980e78faf7c7 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:17:10.001105 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-26ded2ef-5e9c-447e-888b-980e78faf7c7 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1" status: 200 len: 1371 microversion: 2.1 time: 0.685347 Jul 22 11:17:10.001975 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 210/422] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:17:09 2022] GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1 => generated 1371 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:17:10.107628 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-83d76b7f-9f94-4fa4-97fb-f5f122ece884 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:17:10.123377 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-83d76b7f-9f94-4fa4-97fb-f5f122ece884 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1721 microversion: 2.1 time: 0.218964 Jul 22 11:17:10.124424 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 213/423] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:17:09 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1721 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:17:10.381037 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [req-02df4c07-2048-4079-9b41-627a3ef6abeb req-1da9ef8b-bd4a-4e1b-8bb3-e4baf6824a13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39fe8666-e4cc-464c-9af9-bd43835bccf6", "tag": "2dfea6d8-ff88-4cd2-885a-008177cdfd33"}]} {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:17:10.391782 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-02df4c07-2048-4079-9b41-627a3ef6abeb req-1da9ef8b-bd4a-4e1b-8bb3-e4baf6824a13 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:10.392644 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-02df4c07-2048-4079-9b41-627a3ef6abeb req-1da9ef8b-bd4a-4e1b-8bb3-e4baf6824a13 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:10.406537 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.compute.server_external_events [req-02df4c07-2048-4079-9b41-627a3ef6abeb req-1da9ef8b-bd4a-4e1b-8bb3-e4baf6824a13 service nova] Creating event network-changed:2dfea6d8-ff88-4cd2-885a-008177cdfd33 for instance 39fe8666-e4cc-464c-9af9-bd43835bccf6 on hv-cinder-84890 Jul 22 11:17:10.412618 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [req-02df4c07-2048-4079-9b41-627a3ef6abeb req-1da9ef8b-bd4a-4e1b-8bb3-e4baf6824a13 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035604 Jul 22 11:17:10.414024 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 211/424] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:17:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:17:11.040650 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-307c6aea-914a-4850-ad81-40750063c8cd tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:17:11.044329 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-307c6aea-914a-4850-ad81-40750063c8cd tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 6d50352a-fd4f-4ca5-8e13-2519dfbb66a1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:17:11.066698 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-307c6aea-914a-4850-ad81-40750063c8cd tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:11.068855 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-307c6aea-914a-4850-ad81-40750063c8cd tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:11.071561 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-307c6aea-914a-4850-ad81-40750063c8cd tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:11.073184 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-307c6aea-914a-4850-ad81-40750063c8cd tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:11.154488 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-80798326-c32d-420b-b884-18917d8a4d9d tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:17:11.155780 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-80798326-c32d-420b-b884-18917d8a4d9d tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:17:11.167574 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-80798326-c32d-420b-b884-18917d8a4d9d tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:11.169365 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-80798326-c32d-420b-b884-18917d8a4d9d tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:11.171013 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-80798326-c32d-420b-b884-18917d8a4d9d tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:11.172122 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-80798326-c32d-420b-b884-18917d8a4d9d tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:11.372045 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-307c6aea-914a-4850-ad81-40750063c8cd tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:17:11.387994 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-307c6aea-914a-4850-ad81-40750063c8cd tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1" status: 200 len: 1565 microversion: 2.1 time: 0.364549 Jul 22 11:17:11.388987 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 214/425] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:17:11 2022] GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1 => generated 1565 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:17:11.409333 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-ed73c5a9-de7d-4fd4-8aff-ff48e9cd05fb tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:17:11.410604 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-ed73c5a9-de7d-4fd4-8aff-ff48e9cd05fb tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 6d50352a-fd4f-4ca5-8e13-2519dfbb66a1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:17:11.423079 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ed73c5a9-de7d-4fd4-8aff-ff48e9cd05fb tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:11.424337 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ed73c5a9-de7d-4fd4-8aff-ff48e9cd05fb tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:11.425887 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ed73c5a9-de7d-4fd4-8aff-ff48e9cd05fb tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:11.426750 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ed73c5a9-de7d-4fd4-8aff-ff48e9cd05fb tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:11.549301 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-80798326-c32d-420b-b884-18917d8a4d9d tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:17:11.565983 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-80798326-c32d-420b-b884-18917d8a4d9d tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1721 microversion: 2.1 time: 0.418639 Jul 22 11:17:11.586874 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 212/426] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:17:11 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1721 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:17:11.679344 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-ed73c5a9-de7d-4fd4-8aff-ff48e9cd05fb tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.274994 Jul 22 11:17:11.680396 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 215/427] 10.222.0.20 () {58 vars in 1274 bytes} [Fri Jul 22 11:17:11 2022] GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1/os-interface => generated 284 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 22 11:17:12.187144 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-88b7897b-3bc8-4775-88f3-7e8af0b84b64 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1723185665"}} {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:17:12.188316 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-88b7897b-3bc8-4775-88f3-7e8af0b84b64 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] [instance: 39fe8666-e4cc-464c-9af9-bd43835bccf6] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:17:12.199977 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-88b7897b-3bc8-4775-88f3-7e8af0b84b64 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:12.200989 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-88b7897b-3bc8-4775-88f3-7e8af0b84b64 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:12.203115 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-88b7897b-3bc8-4775-88f3-7e8af0b84b64 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:12.204591 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-88b7897b-3bc8-4775-88f3-7e8af0b84b64 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:12.500822 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.network.security_group_api [None req-88b7897b-3bc8-4775-88f3-7e8af0b84b64 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Adding security group 80829b56-b05b-46bf-8e3c-cc68252d7c0b to port 2dfea6d8-ff88-4cd2-885a-008177cdfd33 Jul 22 11:17:12.595971 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-c7e45a9e-f2e4-43b9-bef0-02645ccf1002 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:17:12.597016 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-c7e45a9e-f2e4-43b9-bef0-02645ccf1002 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:17:12.606629 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c7e45a9e-f2e4-43b9-bef0-02645ccf1002 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:12.607380 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c7e45a9e-f2e4-43b9-bef0-02645ccf1002 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:12.609019 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c7e45a9e-f2e4-43b9-bef0-02645ccf1002 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:12.609780 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c7e45a9e-f2e4-43b9-bef0-02645ccf1002 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:12.834569 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-c7e45a9e-f2e4-43b9-bef0-02645ccf1002 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:17:12.848234 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-c7e45a9e-f2e4-43b9-bef0-02645ccf1002 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1721 microversion: 2.1 time: 0.258100 Jul 22 11:17:12.849078 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 216/428] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:17:12 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1721 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:17:13.294520 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-88b7897b-3bc8-4775-88f3-7e8af0b84b64 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] 10.222.0.20 "POST /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6/action" status: 202 len: 0 microversion: 2.1 time: 1.112283 Jul 22 11:17:13.301318 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 213/429] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Jul 22 11:17:12 2022] POST /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6/action => generated 0 bytes in 1120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 22 11:17:13.309368 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-99b7c7a9-3d9d-4267-8812-a768aad0a989 req-5535f3db-7fe6-46a4-b9ae-4d7c2c51bd2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39fe8666-e4cc-464c-9af9-bd43835bccf6", "tag": "2dfea6d8-ff88-4cd2-885a-008177cdfd33"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:17:13.319080 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-8b01ec7d-9cd7-4f09-8091-ccb6b1f0c0e4 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:17:13.320436 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-8b01ec7d-9cd7-4f09-8091-ccb6b1f0c0e4 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] [instance: 39fe8666-e4cc-464c-9af9-bd43835bccf6] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:17:13.338719 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-99b7c7a9-3d9d-4267-8812-a768aad0a989 req-5535f3db-7fe6-46a4-b9ae-4d7c2c51bd2b service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:13.339585 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-99b7c7a9-3d9d-4267-8812-a768aad0a989 req-5535f3db-7fe6-46a4-b9ae-4d7c2c51bd2b service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:13.342538 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-8b01ec7d-9cd7-4f09-8091-ccb6b1f0c0e4 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:13.343705 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-8b01ec7d-9cd7-4f09-8091-ccb6b1f0c0e4 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:13.345431 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-8b01ec7d-9cd7-4f09-8091-ccb6b1f0c0e4 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:13.346441 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-8b01ec7d-9cd7-4f09-8091-ccb6b1f0c0e4 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:13.391235 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-99b7c7a9-3d9d-4267-8812-a768aad0a989 req-5535f3db-7fe6-46a4-b9ae-4d7c2c51bd2b service nova] Creating event network-changed:2dfea6d8-ff88-4cd2-885a-008177cdfd33 for instance 39fe8666-e4cc-464c-9af9-bd43835bccf6 on hv-cinder-84890 Jul 22 11:17:13.413381 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-99b7c7a9-3d9d-4267-8812-a768aad0a989 req-5535f3db-7fe6-46a4-b9ae-4d7c2c51bd2b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110910 Jul 22 11:17:13.414877 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 217/430] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:17:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:17:13.797308 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-8b01ec7d-9cd7-4f09-8091-ccb6b1f0c0e4 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e908d2b09dfc4a139d9c27f52580e15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84fa2f397c54be1b409d8be5ebc8491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:17:13.808528 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-8b01ec7d-9cd7-4f09-8091-ccb6b1f0c0e4 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] 10.222.0.20 "GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6" status: 200 len: 1758 microversion: 2.1 time: 0.503489 Jul 22 11:17:13.810052 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 214/431] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:17:13 2022] GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6 => generated 1758 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:17:13.877563 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-426c759b-4dc7-4880-aed4-5767aa7e8801 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:17:13.878894 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-426c759b-4dc7-4880-aed4-5767aa7e8801 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:17:13.886875 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-426c759b-4dc7-4880-aed4-5767aa7e8801 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:13.887652 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-426c759b-4dc7-4880-aed4-5767aa7e8801 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:13.888622 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-426c759b-4dc7-4880-aed4-5767aa7e8801 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:13.889254 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-426c759b-4dc7-4880-aed4-5767aa7e8801 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:14.103770 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-426c759b-4dc7-4880-aed4-5767aa7e8801 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:17:14.139877 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-426c759b-4dc7-4880-aed4-5767aa7e8801 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1721 microversion: 2.1 time: 0.268077 Jul 22 11:17:14.143414 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 218/432] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:17:13 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1721 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:17:15.164400 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-96625bc8-7edf-4d6b-97fb-bad59aa7b0b4 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:17:15.165301 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-96625bc8-7edf-4d6b-97fb-bad59aa7b0b4 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:17:15.176393 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-96625bc8-7edf-4d6b-97fb-bad59aa7b0b4 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:15.177114 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-96625bc8-7edf-4d6b-97fb-bad59aa7b0b4 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:15.178433 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-96625bc8-7edf-4d6b-97fb-bad59aa7b0b4 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:15.179133 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-96625bc8-7edf-4d6b-97fb-bad59aa7b0b4 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:15.396071 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-96625bc8-7edf-4d6b-97fb-bad59aa7b0b4 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:17:15.405313 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-96625bc8-7edf-4d6b-97fb-bad59aa7b0b4 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1721 microversion: 2.1 time: 0.244917 Jul 22 11:17:15.405908 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 215/433] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:17:15 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1721 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:17:15.459192 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-eb262e7f-2a7a-435b-aa85-b36f31708656 req-accaeaf0-dfae-46b2-8acc-63f100562e31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d50352a-fd4f-4ca5-8e13-2519dfbb66a1", "tag": "fa52f10e-8382-40d6-8633-f6bcf76980e8"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:17:15.473513 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-eb262e7f-2a7a-435b-aa85-b36f31708656 req-accaeaf0-dfae-46b2-8acc-63f100562e31 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:15.474247 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-eb262e7f-2a7a-435b-aa85-b36f31708656 req-accaeaf0-dfae-46b2-8acc-63f100562e31 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:15.494687 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-eb262e7f-2a7a-435b-aa85-b36f31708656 req-accaeaf0-dfae-46b2-8acc-63f100562e31 service nova] Creating event network-changed:fa52f10e-8382-40d6-8633-f6bcf76980e8 for instance 6d50352a-fd4f-4ca5-8e13-2519dfbb66a1 on hv-cinder-84890 Jul 22 11:17:15.505251 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-eb262e7f-2a7a-435b-aa85-b36f31708656 req-accaeaf0-dfae-46b2-8acc-63f100562e31 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049654 Jul 22 11:17:15.506081 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 219/434] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:17:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:17:16.432700 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-db93b847-f597-4a4e-8798-01bcc0ac5717 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:17:16.433888 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-db93b847-f597-4a4e-8798-01bcc0ac5717 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:17:16.441115 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-db93b847-f597-4a4e-8798-01bcc0ac5717 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:16.441560 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-db93b847-f597-4a4e-8798-01bcc0ac5717 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:16.442503 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-db93b847-f597-4a4e-8798-01bcc0ac5717 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:16.442944 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-db93b847-f597-4a4e-8798-01bcc0ac5717 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:16.649250 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-db93b847-f597-4a4e-8798-01bcc0ac5717 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:17:16.658192 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-db93b847-f597-4a4e-8798-01bcc0ac5717 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1721 microversion: 2.1 time: 0.231612 Jul 22 11:17:16.658918 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 216/435] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:17:16 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1721 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:17:17.682566 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-e2a36980-89ba-4965-89a8-e2dee5098ab0 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:17:17.684335 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-e2a36980-89ba-4965-89a8-e2dee5098ab0 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:17:17.698559 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e2a36980-89ba-4965-89a8-e2dee5098ab0 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:17.699967 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e2a36980-89ba-4965-89a8-e2dee5098ab0 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:17.701352 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e2a36980-89ba-4965-89a8-e2dee5098ab0 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:17.702374 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e2a36980-89ba-4965-89a8-e2dee5098ab0 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:17.905674 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-e2a36980-89ba-4965-89a8-e2dee5098ab0 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:17:17.919081 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-e2a36980-89ba-4965-89a8-e2dee5098ab0 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1721 microversion: 2.1 time: 0.244946 Jul 22 11:17:17.919702 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 220/436] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:17:17 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1721 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:17:18.946054 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-f3c5ce22-5acf-4cd1-aef9-5a918a70d610 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:17:18.947048 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-f3c5ce22-5acf-4cd1-aef9-5a918a70d610 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:17:18.958576 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f3c5ce22-5acf-4cd1-aef9-5a918a70d610 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:18.959290 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f3c5ce22-5acf-4cd1-aef9-5a918a70d610 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:18.960551 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f3c5ce22-5acf-4cd1-aef9-5a918a70d610 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:18.961302 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f3c5ce22-5acf-4cd1-aef9-5a918a70d610 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:19.149142 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-f3c5ce22-5acf-4cd1-aef9-5a918a70d610 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:17:19.164186 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-f3c5ce22-5acf-4cd1-aef9-5a918a70d610 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1721 microversion: 2.1 time: 0.224618 Jul 22 11:17:19.165153 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 217/437] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:17:18 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1721 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:17:20.193997 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-17f7d870-762f-414e-b64d-e30becae3c07 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:17:20.194950 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-17f7d870-762f-414e-b64d-e30becae3c07 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:17:20.205256 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-17f7d870-762f-414e-b64d-e30becae3c07 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:20.206087 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-17f7d870-762f-414e-b64d-e30becae3c07 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:20.207546 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-17f7d870-762f-414e-b64d-e30becae3c07 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:20.208404 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-17f7d870-762f-414e-b64d-e30becae3c07 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:20.213031 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=100 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:17:20.392498 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-17f7d870-762f-414e-b64d-e30becae3c07 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:17:20.401625 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-17f7d870-762f-414e-b64d-e30becae3c07 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1721 microversion: 2.1 time: 0.214157 Jul 22 11:17:20.402234 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 221/438] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:17:20 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1721 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:17:21.421563 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-64a5a3ff-16a6-4d69-b294-968d8eb4bf2a tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:17:21.422596 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-64a5a3ff-16a6-4d69-b294-968d8eb4bf2a tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:17:21.436233 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-64a5a3ff-16a6-4d69-b294-968d8eb4bf2a tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:21.436233 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-64a5a3ff-16a6-4d69-b294-968d8eb4bf2a tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:21.437359 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-64a5a3ff-16a6-4d69-b294-968d8eb4bf2a tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:21.437968 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-64a5a3ff-16a6-4d69-b294-968d8eb4bf2a tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:21.611409 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-64a5a3ff-16a6-4d69-b294-968d8eb4bf2a tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:17:21.624161 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-64a5a3ff-16a6-4d69-b294-968d8eb4bf2a tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1721 microversion: 2.1 time: 0.208263 Jul 22 11:17:21.625196 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 218/439] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:17:21 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1721 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:17:22.645087 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-a6fab81c-20fc-4235-b616-d0c0698a3db4 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:17:22.646337 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-a6fab81c-20fc-4235-b616-d0c0698a3db4 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:17:22.657456 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a6fab81c-20fc-4235-b616-d0c0698a3db4 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:22.657951 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a6fab81c-20fc-4235-b616-d0c0698a3db4 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:22.658934 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a6fab81c-20fc-4235-b616-d0c0698a3db4 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:22.659512 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a6fab81c-20fc-4235-b616-d0c0698a3db4 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:22.830247 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-a6fab81c-20fc-4235-b616-d0c0698a3db4 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:17:22.842046 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-a6fab81c-20fc-4235-b616-d0c0698a3db4 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1698 microversion: 2.1 time: 0.202590 Jul 22 11:17:22.843047 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 222/440] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:17:22 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1698 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:17:22.872124 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-a3d90068-c7ab-4d20-9a37-58a4c894011a tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:17:22.883964 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-a3d90068-c7ab-4d20-9a37-58a4c894011a tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:22.884766 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-a3d90068-c7ab-4d20-9a37-58a4c894011a tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:22.914566 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-a3d90068-c7ab-4d20-9a37-58a4c894011a tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Going to try to start instance {{(pid=117884) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 22 11:17:22.967935 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-a3d90068-c7ab-4d20-9a37-58a4c894011a tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "POST /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1/action" status: 202 len: 0 microversion: 2.1 time: 0.103337 Jul 22 11:17:22.968598 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 219/441] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Jul 22 11:17:22 2022] POST /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 22 11:17:22.984844 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-8be70f49-0e1a-446c-a253-622224338b80 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:17:22.986015 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-8be70f49-0e1a-446c-a253-622224338b80 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:17:22.998806 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8be70f49-0e1a-446c-a253-622224338b80 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:22.999330 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8be70f49-0e1a-446c-a253-622224338b80 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:23.000498 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8be70f49-0e1a-446c-a253-622224338b80 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:23.000945 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8be70f49-0e1a-446c-a253-622224338b80 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:23.206809 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-8be70f49-0e1a-446c-a253-622224338b80 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:17:23.216952 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-8be70f49-0e1a-446c-a253-622224338b80 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1707 microversion: 2.1 time: 0.243385 Jul 22 11:17:23.218102 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 223/442] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:17:22 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1707 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:17:24.237943 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-34e2e38f-def3-426c-82d0-4d0a00fd3b05 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:17:24.238658 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-34e2e38f-def3-426c-82d0-4d0a00fd3b05 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:17:24.246838 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-34e2e38f-def3-426c-82d0-4d0a00fd3b05 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:24.247323 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-34e2e38f-def3-426c-82d0-4d0a00fd3b05 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:24.248094 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-34e2e38f-def3-426c-82d0-4d0a00fd3b05 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:24.248524 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-34e2e38f-def3-426c-82d0-4d0a00fd3b05 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:24.435796 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-34e2e38f-def3-426c-82d0-4d0a00fd3b05 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:17:24.449430 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-34e2e38f-def3-426c-82d0-4d0a00fd3b05 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1707 microversion: 2.1 time: 0.215822 Jul 22 11:17:24.450373 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 220/443] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:17:24 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1707 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:17:25.477583 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-4ddf9904-5fb1-4bde-9470-bcf06158e340 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:17:25.478447 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-4ddf9904-5fb1-4bde-9470-bcf06158e340 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:17:25.486307 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4ddf9904-5fb1-4bde-9470-bcf06158e340 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:25.486797 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4ddf9904-5fb1-4bde-9470-bcf06158e340 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:25.487741 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4ddf9904-5fb1-4bde-9470-bcf06158e340 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:25.488253 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4ddf9904-5fb1-4bde-9470-bcf06158e340 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:25.702902 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-4ddf9904-5fb1-4bde-9470-bcf06158e340 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:17:25.712207 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-4ddf9904-5fb1-4bde-9470-bcf06158e340 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1707 microversion: 2.1 time: 0.241775 Jul 22 11:17:25.712980 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 224/444] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:17:25 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1707 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:17:26.739821 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-e93e8bf5-73be-4474-a15f-c0ad2ea1e13a tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:17:26.740455 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-e93e8bf5-73be-4474-a15f-c0ad2ea1e13a tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:17:26.748652 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-e93e8bf5-73be-4474-a15f-c0ad2ea1e13a tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:26.749324 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-e93e8bf5-73be-4474-a15f-c0ad2ea1e13a tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:26.750688 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-e93e8bf5-73be-4474-a15f-c0ad2ea1e13a tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:26.751218 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-e93e8bf5-73be-4474-a15f-c0ad2ea1e13a tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:26.963689 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-e93e8bf5-73be-4474-a15f-c0ad2ea1e13a tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:17:26.975213 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-e93e8bf5-73be-4474-a15f-c0ad2ea1e13a tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1711 microversion: 2.1 time: 0.240861 Jul 22 11:17:26.976194 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 221/445] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:17:26 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1711 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:17:44.904691 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-54a38377-8574-40a8-9995-3c890ad0158b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:17:44.905276 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-54a38377-8574-40a8-9995-3c890ad0158b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:17:44.907295 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_api:SELECT=23 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:17:44.907952 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=23 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:17:44.917975 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-54a38377-8574-40a8-9995-3c890ad0158b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:44.918432 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-54a38377-8574-40a8-9995-3c890ad0158b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:44.919556 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-54a38377-8574-40a8-9995-3c890ad0158b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:44.920349 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-54a38377-8574-40a8-9995-3c890ad0158b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:44.954691 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-54a38377-8574-40a8-9995-3c890ad0158b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54/ips" status: 200 len: 151 microversion: 2.20 time: 0.054011 Jul 22 11:17:44.955466 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 225/446] 10.222.0.20 () {60 vars in 1288 bytes} [Fri Jul 22 11:17:44 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54/ips => generated 151 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 22 11:17:46.934806 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-68180445-1906-4b83-819e-d157b0281317 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:17:46.935431 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-68180445-1906-4b83-819e-d157b0281317 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:17:46.937787 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG dbcounter [-] [117884] Writing DB stats nova_api:SELECT=49 {{(pid=117884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:17:46.938448 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG dbcounter [-] [117884] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:17:46.944925 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-68180445-1906-4b83-819e-d157b0281317 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:46.945365 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-68180445-1906-4b83-819e-d157b0281317 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:46.946144 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-68180445-1906-4b83-819e-d157b0281317 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:46.946574 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-68180445-1906-4b83-819e-d157b0281317 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:46.980719 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.objects.instance [None req-68180445-1906-4b83-819e-d157b0281317 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lazy-loading 'flavor' on Instance uuid 1f27dab8-c005-4dd0-b262-542deb60dd54 {{(pid=117884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 22 11:17:47.315847 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-68180445-1906-4b83-819e-d157b0281317 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "POST /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54/action" status: 202 len: 0 microversion: 2.20 time: 0.387383 Jul 22 11:17:47.316514 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 222/447] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Jul 22 11:17:46 2022] POST /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54/action => generated 0 bytes in 389 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 22 11:17:47.327069 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-f4433750-7553-4fdf-a052-d0f3f9f01e42 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:17:47.328116 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-f4433750-7553-4fdf-a052-d0f3f9f01e42 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:17:47.335996 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f4433750-7553-4fdf-a052-d0f3f9f01e42 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:47.336492 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f4433750-7553-4fdf-a052-d0f3f9f01e42 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:47.337289 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f4433750-7553-4fdf-a052-d0f3f9f01e42 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:47.337804 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f4433750-7553-4fdf-a052-d0f3f9f01e42 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:47.509033 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-f4433750-7553-4fdf-a052-d0f3f9f01e42 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:17:47.518317 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-f4433750-7553-4fdf-a052-d0f3f9f01e42 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:17:47.520111 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-f4433750-7553-4fdf-a052-d0f3f9f01e42 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:17:47.521345 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-f4433750-7553-4fdf-a052-d0f3f9f01e42 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54" status: 200 len: 1724 microversion: 2.20 time: 0.199360 Jul 22 11:17:47.521909 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 226/448] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:17:47 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 => generated 1724 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:17:48.545875 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-7e3eae66-5950-4e29-9b25-bbef1fd1fbff tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:17:48.546585 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-7e3eae66-5950-4e29-9b25-bbef1fd1fbff tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:17:48.553554 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-7e3eae66-5950-4e29-9b25-bbef1fd1fbff tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:48.554066 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-7e3eae66-5950-4e29-9b25-bbef1fd1fbff tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:48.554858 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-7e3eae66-5950-4e29-9b25-bbef1fd1fbff tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:48.555317 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-7e3eae66-5950-4e29-9b25-bbef1fd1fbff tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:48.718941 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-7e3eae66-5950-4e29-9b25-bbef1fd1fbff tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:17:48.727234 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-7e3eae66-5950-4e29-9b25-bbef1fd1fbff tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:17:48.728796 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-7e3eae66-5950-4e29-9b25-bbef1fd1fbff tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:17:48.729971 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-7e3eae66-5950-4e29-9b25-bbef1fd1fbff tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54" status: 200 len: 1724 microversion: 2.20 time: 0.189771 Jul 22 11:17:48.730530 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 223/449] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:17:48 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 => generated 1724 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 22 11:17:49.753360 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-50d653e5-e775-4e04-8cf5-d99c008e5488 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:17:49.754526 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-50d653e5-e775-4e04-8cf5-d99c008e5488 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:17:49.763513 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-50d653e5-e775-4e04-8cf5-d99c008e5488 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:49.763966 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-50d653e5-e775-4e04-8cf5-d99c008e5488 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:49.764751 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-50d653e5-e775-4e04-8cf5-d99c008e5488 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:49.765188 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-50d653e5-e775-4e04-8cf5-d99c008e5488 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:49.933496 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-50d653e5-e775-4e04-8cf5-d99c008e5488 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:17:49.941930 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-50d653e5-e775-4e04-8cf5-d99c008e5488 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:17:49.943640 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-50d653e5-e775-4e04-8cf5-d99c008e5488 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:17:49.944877 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-50d653e5-e775-4e04-8cf5-d99c008e5488 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54" status: 200 len: 1724 microversion: 2.20 time: 0.196255 Jul 22 11:17:49.945446 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 227/450] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:17:49 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 => generated 1724 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:17:50.964329 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-bda37273-c356-4700-8174-0b1ba75fb927 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:17:50.964882 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-bda37273-c356-4700-8174-0b1ba75fb927 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:17:50.971788 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-bda37273-c356-4700-8174-0b1ba75fb927 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:50.972222 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-bda37273-c356-4700-8174-0b1ba75fb927 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:50.973004 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-bda37273-c356-4700-8174-0b1ba75fb927 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:50.973673 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-bda37273-c356-4700-8174-0b1ba75fb927 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:51.122522 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-bda37273-c356-4700-8174-0b1ba75fb927 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:17:51.132934 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-bda37273-c356-4700-8174-0b1ba75fb927 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:17:51.134544 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-bda37273-c356-4700-8174-0b1ba75fb927 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:17:51.135754 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-bda37273-c356-4700-8174-0b1ba75fb927 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54" status: 200 len: 1724 microversion: 2.20 time: 0.175741 Jul 22 11:17:51.136325 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 224/451] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:17:50 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:17:52.154647 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-1c6e3cfc-d8a2-4ef3-b3ae-aa56d792ae3f tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:17:52.155451 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-1c6e3cfc-d8a2-4ef3-b3ae-aa56d792ae3f tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:17:52.163727 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1c6e3cfc-d8a2-4ef3-b3ae-aa56d792ae3f tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:52.164183 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1c6e3cfc-d8a2-4ef3-b3ae-aa56d792ae3f tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:52.165029 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1c6e3cfc-d8a2-4ef3-b3ae-aa56d792ae3f tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:52.166691 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1c6e3cfc-d8a2-4ef3-b3ae-aa56d792ae3f tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:52.311287 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-1c6e3cfc-d8a2-4ef3-b3ae-aa56d792ae3f tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:17:52.324538 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-1c6e3cfc-d8a2-4ef3-b3ae-aa56d792ae3f tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:17:52.326927 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-1c6e3cfc-d8a2-4ef3-b3ae-aa56d792ae3f tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:17:52.328980 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-1c6e3cfc-d8a2-4ef3-b3ae-aa56d792ae3f tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54" status: 200 len: 1724 microversion: 2.20 time: 0.178568 Jul 22 11:17:52.329827 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 228/452] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:17:52 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:17:53.357100 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-878afb8c-2b3d-443b-9a73-bfab55870a31 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:17:53.357984 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-878afb8c-2b3d-443b-9a73-bfab55870a31 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:17:53.366054 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-878afb8c-2b3d-443b-9a73-bfab55870a31 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:53.366054 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-878afb8c-2b3d-443b-9a73-bfab55870a31 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:53.366436 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-878afb8c-2b3d-443b-9a73-bfab55870a31 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:53.366714 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-878afb8c-2b3d-443b-9a73-bfab55870a31 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:53.516742 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-878afb8c-2b3d-443b-9a73-bfab55870a31 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:17:53.526875 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-878afb8c-2b3d-443b-9a73-bfab55870a31 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:17:53.528432 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-878afb8c-2b3d-443b-9a73-bfab55870a31 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:17:53.529603 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-878afb8c-2b3d-443b-9a73-bfab55870a31 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54" status: 200 len: 1724 microversion: 2.20 time: 0.179922 Jul 22 11:17:53.530168 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 225/453] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:17:53 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:17:54.549125 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-bd95dbc1-610a-4ff0-808b-3a8c7c1ce0bf tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:17:54.550001 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-bd95dbc1-610a-4ff0-808b-3a8c7c1ce0bf tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:17:54.556371 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-bd95dbc1-610a-4ff0-808b-3a8c7c1ce0bf tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:54.556847 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-bd95dbc1-610a-4ff0-808b-3a8c7c1ce0bf tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:54.557612 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-bd95dbc1-610a-4ff0-808b-3a8c7c1ce0bf tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:54.558040 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-bd95dbc1-610a-4ff0-808b-3a8c7c1ce0bf tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:54.714097 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-bd95dbc1-610a-4ff0-808b-3a8c7c1ce0bf tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:17:54.723030 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-bd95dbc1-610a-4ff0-808b-3a8c7c1ce0bf tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:17:54.724820 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-bd95dbc1-610a-4ff0-808b-3a8c7c1ce0bf tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:17:54.726114 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-bd95dbc1-610a-4ff0-808b-3a8c7c1ce0bf tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54" status: 200 len: 1724 microversion: 2.20 time: 0.180826 Jul 22 11:17:54.726726 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 229/454] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:17:54 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 22 11:17:55.745581 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-79d89b74-ea30-4fc4-97ee-eda71fe7f9c9 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:17:55.746171 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-79d89b74-ea30-4fc4-97ee-eda71fe7f9c9 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:17:55.753133 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-79d89b74-ea30-4fc4-97ee-eda71fe7f9c9 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:55.753599 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-79d89b74-ea30-4fc4-97ee-eda71fe7f9c9 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:55.754410 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-79d89b74-ea30-4fc4-97ee-eda71fe7f9c9 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:55.754839 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-79d89b74-ea30-4fc4-97ee-eda71fe7f9c9 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:55.925672 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-79d89b74-ea30-4fc4-97ee-eda71fe7f9c9 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:17:55.936633 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-79d89b74-ea30-4fc4-97ee-eda71fe7f9c9 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:17:55.938153 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-79d89b74-ea30-4fc4-97ee-eda71fe7f9c9 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:17:55.939377 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-79d89b74-ea30-4fc4-97ee-eda71fe7f9c9 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54" status: 200 len: 1724 microversion: 2.20 time: 0.197935 Jul 22 11:17:55.939943 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 226/455] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:17:55 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 => generated 1724 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:17:56.383239 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-4843e394-8f3c-4dac-b41a-b118f3c1dc14 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:17:56.384731 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-4843e394-8f3c-4dac-b41a-b118f3c1dc14 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] [instance: 39fe8666-e4cc-464c-9af9-bd43835bccf6] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:17:56.395206 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4843e394-8f3c-4dac-b41a-b118f3c1dc14 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:56.395845 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4843e394-8f3c-4dac-b41a-b118f3c1dc14 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:56.397371 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4843e394-8f3c-4dac-b41a-b118f3c1dc14 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:56.397965 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4843e394-8f3c-4dac-b41a-b118f3c1dc14 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:56.509050 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-4843e394-8f3c-4dac-b41a-b118f3c1dc14 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] 10.222.0.20 "POST /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6/action" status: 202 len: 0 microversion: 2.1 time: 0.130111 Jul 22 11:17:56.509911 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 230/456] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Jul 22 11:17:56 2022] POST /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 22 11:17:56.519327 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-93c41e63-8b56-45e6-8b8a-4918a1b53e2e tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:17:56.520469 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-93c41e63-8b56-45e6-8b8a-4918a1b53e2e tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] [instance: 39fe8666-e4cc-464c-9af9-bd43835bccf6] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:17:56.530930 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-93c41e63-8b56-45e6-8b8a-4918a1b53e2e tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:56.531700 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-93c41e63-8b56-45e6-8b8a-4918a1b53e2e tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:56.533113 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-93c41e63-8b56-45e6-8b8a-4918a1b53e2e tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:56.533839 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-93c41e63-8b56-45e6-8b8a-4918a1b53e2e tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:56.808806 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-93c41e63-8b56-45e6-8b8a-4918a1b53e2e tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e908d2b09dfc4a139d9c27f52580e15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84fa2f397c54be1b409d8be5ebc8491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:17:56.822816 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-93c41e63-8b56-45e6-8b8a-4918a1b53e2e tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] 10.222.0.20 "GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6" status: 200 len: 1750 microversion: 2.1 time: 0.307619 Jul 22 11:17:56.835330 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 227/457] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:17:56 2022] GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6 => generated 1750 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:17:56.961771 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-7c545ded-d1e1-4792-9fac-c10bb26cf961 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:17:56.962461 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-7c545ded-d1e1-4792-9fac-c10bb26cf961 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:17:56.972325 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7c545ded-d1e1-4792-9fac-c10bb26cf961 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:56.973158 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7c545ded-d1e1-4792-9fac-c10bb26cf961 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:56.974598 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7c545ded-d1e1-4792-9fac-c10bb26cf961 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:56.975424 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7c545ded-d1e1-4792-9fac-c10bb26cf961 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:57.181419 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-7c545ded-d1e1-4792-9fac-c10bb26cf961 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:17:57.191826 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-7c545ded-d1e1-4792-9fac-c10bb26cf961 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:17:57.193347 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-7c545ded-d1e1-4792-9fac-c10bb26cf961 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:17:57.194564 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-7c545ded-d1e1-4792-9fac-c10bb26cf961 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54" status: 200 len: 1724 microversion: 2.20 time: 0.237187 Jul 22 11:17:57.195129 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 231/458] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:17:56 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 => generated 1724 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:17:57.846560 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-28bb2ac9-505f-4552-8275-cc1ad2c95562 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:17:57.847196 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-28bb2ac9-505f-4552-8275-cc1ad2c95562 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] [instance: 39fe8666-e4cc-464c-9af9-bd43835bccf6] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:17:57.855833 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-28bb2ac9-505f-4552-8275-cc1ad2c95562 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:57.856209 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-28bb2ac9-505f-4552-8275-cc1ad2c95562 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:57.857086 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-28bb2ac9-505f-4552-8275-cc1ad2c95562 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:57.857538 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-28bb2ac9-505f-4552-8275-cc1ad2c95562 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:58.032019 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-28bb2ac9-505f-4552-8275-cc1ad2c95562 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e908d2b09dfc4a139d9c27f52580e15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84fa2f397c54be1b409d8be5ebc8491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:17:58.040598 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-28bb2ac9-505f-4552-8275-cc1ad2c95562 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] 10.222.0.20 "GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6" status: 200 len: 1755 microversion: 2.1 time: 0.198271 Jul 22 11:17:58.041753 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 228/459] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:17:57 2022] GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6 => generated 1755 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:17:58.216866 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-203c5ffc-77b7-4967-b58e-734ce63dee51 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:17:58.217592 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-203c5ffc-77b7-4967-b58e-734ce63dee51 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:17:58.225022 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-203c5ffc-77b7-4967-b58e-734ce63dee51 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:58.225512 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-203c5ffc-77b7-4967-b58e-734ce63dee51 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:58.226412 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-203c5ffc-77b7-4967-b58e-734ce63dee51 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:58.226864 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-203c5ffc-77b7-4967-b58e-734ce63dee51 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:58.390732 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-203c5ffc-77b7-4967-b58e-734ce63dee51 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:17:58.400062 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-203c5ffc-77b7-4967-b58e-734ce63dee51 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:17:58.402532 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-203c5ffc-77b7-4967-b58e-734ce63dee51 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:17:58.404109 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-203c5ffc-77b7-4967-b58e-734ce63dee51 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54" status: 200 len: 1724 microversion: 2.20 time: 0.192059 Jul 22 11:17:58.404738 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 232/460] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:17:58 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 => generated 1724 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:17:58.685055 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-3b03755c-031f-4452-a105-36c730f4bf3a tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:17:58.685549 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-3b03755c-031f-4452-a105-36c730f4bf3a tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: d50614d9-5b91-43b0-952b-d5ecc987e85a] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:17:58.691767 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-3b03755c-031f-4452-a105-36c730f4bf3a tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:58.692210 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-3b03755c-031f-4452-a105-36c730f4bf3a tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:58.692989 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-3b03755c-031f-4452-a105-36c730f4bf3a tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:58.693431 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-3b03755c-031f-4452-a105-36c730f4bf3a tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:58.724302 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-3b03755c-031f-4452-a105-36c730f4bf3a tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/d50614d9-5b91-43b0-952b-d5ecc987e85a/ips" status: 200 len: 149 microversion: 2.1 time: 0.043345 Jul 22 11:17:58.725924 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 229/461] 10.222.0.20 () {58 vars in 1247 bytes} [Fri Jul 22 11:17:58 2022] GET /compute/v2.1/servers/d50614d9-5b91-43b0-952b-d5ecc987e85a/ips => generated 149 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 22 11:17:58.738677 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-5d0ab256-e683-4bde-b836-30eea834d160 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c991934f-a2a3-4c93-b91f-c324e9fc433e"}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:17:58.740266 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-5d0ab256-e683-4bde-b836-30eea834d160 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: d50614d9-5b91-43b0-952b-d5ecc987e85a] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:17:58.746854 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5d0ab256-e683-4bde-b836-30eea834d160 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:58.747438 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5d0ab256-e683-4bde-b836-30eea834d160 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:58.748283 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5d0ab256-e683-4bde-b836-30eea834d160 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:58.748787 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5d0ab256-e683-4bde-b836-30eea834d160 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:58.840053 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.wsgi [None req-5d0ab256-e683-4bde-b836-30eea834d160 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] HTTP exception thrown: Invalid volume: volume c991934f-a2a3-4c93-b91f-c324e9fc433e is already attached to instances: 0501f722-7553-4cba-9675-7bcbabb72887 Jul 22 11:17:58.845230 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-5d0ab256-e683-4bde-b836-30eea834d160 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Request method failure captured: Jul 22 11:17:58.845230 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: request: POST /compute/v2.1/servers/d50614d9-5b91-43b0-952b-d5ecc987e85a/os-volume_attachments HTTP/1.1 Jul 22 11:17:58.845230 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Accept: application/json Jul 22 11:17:58.845230 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Accept-Encoding: identity Jul 22 11:17:58.845230 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Connection: close Jul 22 11:17:58.845230 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Content-Length: 74 Jul 22 11:17:58.845230 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Content-Type: application/json Jul 22 11:17:58.845230 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Host: 10.222.0.20 Jul 22 11:17:58.845230 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Openstack-System-Scope: None Jul 22 11:17:58.845230 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: User-Agent: python-urllib3/1.26.9 Jul 22 11:17:58.845230 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Auth-Token: gAAAAABi2oZ52By6vC80uVvQ5nsWGLE19ZXI57S3ld1fjPibH8fuUYjCV8gJDPh42GzMe4RKMojTgGaj2CCjG1yohpK4Rm5k-mOJAFOmJU-P2lN4F8UiP8lUppBYVH0uVfdef6vJD72z_c72VmeWRwsVQhXxsOTWQe5Gh1G1aCThgwUg9CYgRRw Jul 22 11:17:58.845230 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Domain-Id: None Jul 22 11:17:58.845230 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Domain-Name: None Jul 22 11:17:58.845230 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Identity-Status: Confirmed Jul 22 11:17:58.845230 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Is-Admin-Project: True Jul 22 11:17:58.845230 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Project-Domain-Id: default Jul 22 11:17:58.845230 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Project-Domain-Name: Default Jul 22 11:17:58.845230 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Project-Id: 28836b7cb9c646aaaa1bb1c1fae68128 Jul 22 11:17:58.845230 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Project-Name: tempest-AttachVolumeNegativeTest-1017563372 Jul 22 11:17:58.845230 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Role: reader,member Jul 22 11:17:58.845230 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Roles: reader,member Jul 22 11:17:58.846808 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/28836b7cb9c646aaaa1bb1c1fae68128"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_28836b7cb9c646aaaa1bb1c1fae68128", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/28836b7cb9c646aaaa1bb1c1fae68128"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/28836b7cb9c646aaaa1bb1c1fae68128"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jul 22 11:17:58.846808 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Tenant: tempest-AttachVolumeNegativeTest-1017563372 Jul 22 11:17:58.846808 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Tenant-Id: 28836b7cb9c646aaaa1bb1c1fae68128 Jul 22 11:17:58.846808 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1017563372 Jul 22 11:17:58.846808 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User: tempest-AttachVolumeNegativeTest-1017563372-project Jul 22 11:17:58.846808 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User-Domain-Id: default Jul 22 11:17:58.846808 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User-Domain-Name: Default Jul 22 11:17:58.846808 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User-Id: 691877dce1024aeda61629073d74602b Jul 22 11:17:58.846808 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User-Name: tempest-AttachVolumeNegativeTest-1017563372-project Jul 22 11:17:58.846808 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Jul 22 11:17:58.846808 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: {"volumeAttachment": {"volumeId": "c991934f-a2a3-4c93-b91f-c324e9fc433e"}} Jul 22 11:17:58.846808 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: method: > Jul 22 11:17:58.847627 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: exception: Invalid volume: volume c991934f-a2a3-4c93-b91f-c324e9fc433e is already attached to instances: 0501f722-7553-4cba-9675-7bcbabb72887 Jul 22 11:17:58.847627 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: action_args: {'server_id': 'd50614d9-5b91-43b0-952b-d5ecc987e85a', 'body': {'volumeAttachment': {'volumeId': 'c991934f-a2a3-4c93-b91f-c324e9fc433e'}}} Jul 22 11:17:58.847627 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 22 11:17:58.847627 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:17:58.847627 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 22 11:17:58.847627 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 22 11:17:58.847627 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 22 11:17:58.847627 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 22 11:17:58.847627 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 22 11:17:58.847627 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 22 11:17:58.847627 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 22 11:17:58.847627 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 22 11:17:58.847627 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 22 11:17:58.847627 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 22 11:17:58.847627 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume c991934f-a2a3-4c93-b91f-c324e9fc433e is already attached to instances: 0501f722-7553-4cba-9675-7bcbabb72887 Jul 22 11:17:58.847627 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:17:58.847627 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:17:58.847627 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:17:58.847627 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:17:58.849360 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:17:58.849360 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:17:58.849360 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 22 11:17:58.849360 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 22 11:17:58.849360 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 22 11:17:58.849360 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 22 11:17:58.849360 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 22 11:17:58.849360 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 22 11:17:58.849360 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 22 11:17:58.849360 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 22 11:17:58.849360 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 22 11:17:58.849360 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 22 11:17:58.849360 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 22 11:17:58.849360 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 22 11:17:58.849360 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume c991934f-a2a3-4c93-b91f-c324e9fc433e is already attached to instances: 0501f722-7553-4cba-9675-7bcbabb72887 Jul 22 11:17:58.849360 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:17:58.849360 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:17:58.849360 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:17:58.849360 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:17:58.849360 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:17:58.851082 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:17:58.851082 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 22 11:17:58.851082 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 22 11:17:58.851082 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume c991934f-a2a3-4c93-b91f-c324e9fc433e is already attached to instances: 0501f722-7553-4cba-9675-7bcbabb72887 Jul 22 11:17:58.851082 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:17:58.851082 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-5d0ab256-e683-4bde-b836-30eea834d160 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Returning 400 to user: Invalid volume: volume c991934f-a2a3-4c93-b91f-c324e9fc433e is already attached to instances: 0501f722-7553-4cba-9675-7bcbabb72887 {{(pid=117885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 22 11:17:58.851082 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-5d0ab256-e683-4bde-b836-30eea834d160 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "POST /compute/v2.1/servers/d50614d9-5b91-43b0-952b-d5ecc987e85a/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.112359 Jul 22 11:17:58.851082 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 233/462] 10.222.0.20 () {60 vars in 1322 bytes} [Fri Jul 22 11:17:58 2022] POST /compute/v2.1/servers/d50614d9-5b91-43b0-952b-d5ecc987e85a/os-volume_attachments => generated 174 bytes in 115 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 22 11:17:58.858604 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-bd95135e-bb8e-4284-bf3e-efc58b365f48 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:17:58.859836 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-bd95135e-bb8e-4284-bf3e-efc58b365f48 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: d50614d9-5b91-43b0-952b-d5ecc987e85a] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:17:58.871501 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-bd95135e-bb8e-4284-bf3e-efc58b365f48 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:58.872287 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-bd95135e-bb8e-4284-bf3e-efc58b365f48 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:58.873102 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-bd95135e-bb8e-4284-bf3e-efc58b365f48 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:58.873544 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-bd95135e-bb8e-4284-bf3e-efc58b365f48 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:58.902756 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-bd95135e-bb8e-4284-bf3e-efc58b365f48 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: d50614d9-5b91-43b0-952b-d5ecc987e85a] Going to try to terminate instance {{(pid=117884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 22 11:17:59.025269 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-bd95135e-bb8e-4284-bf3e-efc58b365f48 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d50614d9-5b91-43b0-952b-d5ecc987e85a" status: 204 len: 0 microversion: 2.1 time: 0.171967 Jul 22 11:17:59.026691 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 230/463] 10.222.0.20 () {58 vars in 1238 bytes} [Fri Jul 22 11:17:58 2022] DELETE /compute/v2.1/servers/d50614d9-5b91-43b0-952b-d5ecc987e85a => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 22 11:17:59.040480 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-4c9ece3a-3f23-4595-a1c1-5e8ce25b9a28 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:17:59.041746 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-4c9ece3a-3f23-4595-a1c1-5e8ce25b9a28 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: d50614d9-5b91-43b0-952b-d5ecc987e85a] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:17:59.051214 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4c9ece3a-3f23-4595-a1c1-5e8ce25b9a28 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:59.053875 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4c9ece3a-3f23-4595-a1c1-5e8ce25b9a28 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:59.055333 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4c9ece3a-3f23-4595-a1c1-5e8ce25b9a28 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:59.057182 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4c9ece3a-3f23-4595-a1c1-5e8ce25b9a28 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:59.064790 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-1e4fa233-f4d7-4798-a2b4-52418057efc6 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:17:59.065891 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-1e4fa233-f4d7-4798-a2b4-52418057efc6 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] [instance: 39fe8666-e4cc-464c-9af9-bd43835bccf6] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:17:59.076617 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-1e4fa233-f4d7-4798-a2b4-52418057efc6 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:59.077336 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-1e4fa233-f4d7-4798-a2b4-52418057efc6 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:59.078617 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-1e4fa233-f4d7-4798-a2b4-52418057efc6 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:59.079615 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-1e4fa233-f4d7-4798-a2b4-52418057efc6 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:59.249377 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-4c9ece3a-3f23-4595-a1c1-5e8ce25b9a28 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:17:59.258932 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-4c9ece3a-3f23-4595-a1c1-5e8ce25b9a28 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/d50614d9-5b91-43b0-952b-d5ecc987e85a" status: 200 len: 1681 microversion: 2.1 time: 0.225502 Jul 22 11:17:59.264084 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 234/464] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:17:59 2022] GET /compute/v2.1/servers/d50614d9-5b91-43b0-952b-d5ecc987e85a => generated 1681 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:17:59.287521 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-1e4fa233-f4d7-4798-a2b4-52418057efc6 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e908d2b09dfc4a139d9c27f52580e15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84fa2f397c54be1b409d8be5ebc8491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:17:59.300178 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-1e4fa233-f4d7-4798-a2b4-52418057efc6 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] 10.222.0.20 "GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6" status: 200 len: 1755 microversion: 2.1 time: 0.243879 Jul 22 11:17:59.300766 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 231/465] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:17:59 2022] GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6 => generated 1755 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:17:59.423138 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-324946e7-e952-4454-a553-fb38947a64c6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:17:59.423840 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-324946e7-e952-4454-a553-fb38947a64c6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:17:59.430292 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-324946e7-e952-4454-a553-fb38947a64c6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:59.430635 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-324946e7-e952-4454-a553-fb38947a64c6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:59.431473 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-324946e7-e952-4454-a553-fb38947a64c6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:17:59.431912 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-324946e7-e952-4454-a553-fb38947a64c6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:17:59.605806 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-324946e7-e952-4454-a553-fb38947a64c6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:17:59.616805 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-324946e7-e952-4454-a553-fb38947a64c6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:17:59.618700 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-324946e7-e952-4454-a553-fb38947a64c6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:17:59.620512 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-324946e7-e952-4454-a553-fb38947a64c6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54" status: 200 len: 1724 microversion: 2.20 time: 0.201518 Jul 22 11:17:59.621081 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 235/466] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:17:59 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 => generated 1724 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:18:00.284305 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-e6833637-e17a-4ec3-9b8a-0cbf6bbc79c1 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:00.284913 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-e6833637-e17a-4ec3-9b8a-0cbf6bbc79c1 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: d50614d9-5b91-43b0-952b-d5ecc987e85a] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:00.292517 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-e6833637-e17a-4ec3-9b8a-0cbf6bbc79c1 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:00.292961 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-e6833637-e17a-4ec3-9b8a-0cbf6bbc79c1 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:00.294247 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-e6833637-e17a-4ec3-9b8a-0cbf6bbc79c1 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:00.294676 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-e6833637-e17a-4ec3-9b8a-0cbf6bbc79c1 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:00.320545 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-8a9fdbb1-dcf1-4773-a003-18ac40888afb tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:00.321274 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-8a9fdbb1-dcf1-4773-a003-18ac40888afb tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] [instance: 39fe8666-e4cc-464c-9af9-bd43835bccf6] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:00.328304 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8a9fdbb1-dcf1-4773-a003-18ac40888afb tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:00.328755 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8a9fdbb1-dcf1-4773-a003-18ac40888afb tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:00.329540 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8a9fdbb1-dcf1-4773-a003-18ac40888afb tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:00.329982 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8a9fdbb1-dcf1-4773-a003-18ac40888afb tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:00.461299 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-e6833637-e17a-4ec3-9b8a-0cbf6bbc79c1 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:00.475119 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-e6833637-e17a-4ec3-9b8a-0cbf6bbc79c1 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/d50614d9-5b91-43b0-952b-d5ecc987e85a" status: 200 len: 1681 microversion: 2.1 time: 0.194438 Jul 22 11:18:00.476088 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 232/467] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:00 2022] GET /compute/v2.1/servers/d50614d9-5b91-43b0-952b-d5ecc987e85a => generated 1681 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:18:00.522736 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-8a9fdbb1-dcf1-4773-a003-18ac40888afb tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e908d2b09dfc4a139d9c27f52580e15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84fa2f397c54be1b409d8be5ebc8491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:00.534438 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-8a9fdbb1-dcf1-4773-a003-18ac40888afb tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] 10.222.0.20 "GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6" status: 200 len: 1755 microversion: 2.1 time: 0.217376 Jul 22 11:18:00.535194 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 236/468] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:00 2022] GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6 => generated 1755 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:18:00.640259 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-2e479cd9-37fd-4833-ad5b-8bbb148ba315 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:00.640877 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-2e479cd9-37fd-4833-ad5b-8bbb148ba315 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:00.647573 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-2e479cd9-37fd-4833-ad5b-8bbb148ba315 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:00.648027 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-2e479cd9-37fd-4833-ad5b-8bbb148ba315 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:00.648815 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-2e479cd9-37fd-4833-ad5b-8bbb148ba315 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:00.649252 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-2e479cd9-37fd-4833-ad5b-8bbb148ba315 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:00.917385 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-2e479cd9-37fd-4833-ad5b-8bbb148ba315 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:00.928257 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-2e479cd9-37fd-4833-ad5b-8bbb148ba315 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:00.929774 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-2e479cd9-37fd-4833-ad5b-8bbb148ba315 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:00.930949 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-2e479cd9-37fd-4833-ad5b-8bbb148ba315 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54" status: 200 len: 1724 microversion: 2.20 time: 0.295021 Jul 22 11:18:00.932708 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 233/469] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:18:00 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 => generated 1724 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:18:01.501968 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-2a9a8623-b3de-4851-8c1b-3595db3e6c7c tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:01.502835 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-2a9a8623-b3de-4851-8c1b-3595db3e6c7c tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: d50614d9-5b91-43b0-952b-d5ecc987e85a] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:01.508876 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2a9a8623-b3de-4851-8c1b-3595db3e6c7c tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:01.509323 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2a9a8623-b3de-4851-8c1b-3595db3e6c7c tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:01.510150 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2a9a8623-b3de-4851-8c1b-3595db3e6c7c tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:01.510586 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2a9a8623-b3de-4851-8c1b-3595db3e6c7c tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:01.559472 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-6f4b6aed-69bc-41be-9b3d-a5ba1dc823bd tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:01.561368 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-6f4b6aed-69bc-41be-9b3d-a5ba1dc823bd tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] [instance: 39fe8666-e4cc-464c-9af9-bd43835bccf6] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:01.569450 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-6f4b6aed-69bc-41be-9b3d-a5ba1dc823bd tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:01.569999 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-6f4b6aed-69bc-41be-9b3d-a5ba1dc823bd tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:01.571048 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-6f4b6aed-69bc-41be-9b3d-a5ba1dc823bd tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:01.571668 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-6f4b6aed-69bc-41be-9b3d-a5ba1dc823bd tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:01.770519 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-6f4b6aed-69bc-41be-9b3d-a5ba1dc823bd tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e908d2b09dfc4a139d9c27f52580e15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84fa2f397c54be1b409d8be5ebc8491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:01.779964 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-6f4b6aed-69bc-41be-9b3d-a5ba1dc823bd tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] 10.222.0.20 "GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6" status: 200 len: 1755 microversion: 2.1 time: 0.229432 Jul 22 11:18:01.780691 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 234/470] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:01 2022] GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6 => generated 1755 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:18:01.843077 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-2a9a8623-b3de-4851-8c1b-3595db3e6c7c tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:01.851782 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-2a9a8623-b3de-4851-8c1b-3595db3e6c7c tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/d50614d9-5b91-43b0-952b-d5ecc987e85a" status: 200 len: 1681 microversion: 2.1 time: 0.353533 Jul 22 11:18:01.852388 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 237/471] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:01 2022] GET /compute/v2.1/servers/d50614d9-5b91-43b0-952b-d5ecc987e85a => generated 1681 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:18:01.953126 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-00830298-1b8d-427e-bf53-47d68730057f tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:01.954298 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-00830298-1b8d-427e-bf53-47d68730057f tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:01.964478 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-00830298-1b8d-427e-bf53-47d68730057f tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:01.964997 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-00830298-1b8d-427e-bf53-47d68730057f tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:01.965864 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-00830298-1b8d-427e-bf53-47d68730057f tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:01.966292 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-00830298-1b8d-427e-bf53-47d68730057f tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:01.970772 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG dbcounter [-] [117884] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:18:02.133423 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-00830298-1b8d-427e-bf53-47d68730057f tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:02.147529 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-00830298-1b8d-427e-bf53-47d68730057f tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:02.149028 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-00830298-1b8d-427e-bf53-47d68730057f tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:02.150851 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-00830298-1b8d-427e-bf53-47d68730057f tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54" status: 200 len: 1724 microversion: 2.20 time: 0.204382 Jul 22 11:18:02.151513 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 235/472] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:18:01 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 => generated 1724 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 22 11:18:02.696178 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-96df4037-ef43-4616-8e88-2d6949a62ad0 req-d1855720-450d-43c1-b24a-135db68cb504 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d50614d9-5b91-43b0-952b-d5ecc987e85a", "name": "network-vif-deleted", "tag": "2f780c3c-9237-4cac-b261-2b6b1e51cc1b"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:18:02.708889 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-96df4037-ef43-4616-8e88-2d6949a62ad0 req-d1855720-450d-43c1-b24a-135db68cb504 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:02.709370 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-96df4037-ef43-4616-8e88-2d6949a62ad0 req-d1855720-450d-43c1-b24a-135db68cb504 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:02.724121 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-96df4037-ef43-4616-8e88-2d6949a62ad0 req-d1855720-450d-43c1-b24a-135db68cb504 service nova] Creating event network-vif-deleted:2f780c3c-9237-4cac-b261-2b6b1e51cc1b for instance d50614d9-5b91-43b0-952b-d5ecc987e85a on hv-cinder-84890 Jul 22 11:18:02.730781 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-96df4037-ef43-4616-8e88-2d6949a62ad0 req-d1855720-450d-43c1-b24a-135db68cb504 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041455 Jul 22 11:18:02.732183 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 238/473] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:18:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:18:02.807471 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-1b4fcdd9-89ea-44a9-bb9b-c8692bf88cb9 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:02.808840 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-1b4fcdd9-89ea-44a9-bb9b-c8692bf88cb9 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] [instance: 39fe8666-e4cc-464c-9af9-bd43835bccf6] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:02.818651 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-1b4fcdd9-89ea-44a9-bb9b-c8692bf88cb9 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:02.820095 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-1b4fcdd9-89ea-44a9-bb9b-c8692bf88cb9 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:02.822745 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-1b4fcdd9-89ea-44a9-bb9b-c8692bf88cb9 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:02.823534 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-1b4fcdd9-89ea-44a9-bb9b-c8692bf88cb9 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:02.888320 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-afe56be7-d08b-4542-92b2-dcc3147ca13b tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:02.889836 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-afe56be7-d08b-4542-92b2-dcc3147ca13b tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: d50614d9-5b91-43b0-952b-d5ecc987e85a] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:02.917127 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-afe56be7-d08b-4542-92b2-dcc3147ca13b tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:02.918605 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-afe56be7-d08b-4542-92b2-dcc3147ca13b tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:02.920651 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-afe56be7-d08b-4542-92b2-dcc3147ca13b tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:02.922014 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-afe56be7-d08b-4542-92b2-dcc3147ca13b tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:03.051772 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-afe56be7-d08b-4542-92b2-dcc3147ca13b tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:03.069846 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-afe56be7-d08b-4542-92b2-dcc3147ca13b tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/d50614d9-5b91-43b0-952b-d5ecc987e85a" status: 200 len: 1613 microversion: 2.1 time: 0.199519 Jul 22 11:18:03.073138 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 239/474] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:02 2022] GET /compute/v2.1/servers/d50614d9-5b91-43b0-952b-d5ecc987e85a => generated 1613 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:18:03.132907 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-1b4fcdd9-89ea-44a9-bb9b-c8692bf88cb9 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e908d2b09dfc4a139d9c27f52580e15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84fa2f397c54be1b409d8be5ebc8491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:03.154430 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-1b4fcdd9-89ea-44a9-bb9b-c8692bf88cb9 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] 10.222.0.20 "GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6" status: 200 len: 1755 microversion: 2.1 time: 0.352671 Jul 22 11:18:03.155844 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 236/475] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:02 2022] GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6 => generated 1755 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:18:03.171583 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-377fcec6-9408-43ea-bd09-e7ac3b1e7833 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:03.173848 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-377fcec6-9408-43ea-bd09-e7ac3b1e7833 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:03.183169 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-377fcec6-9408-43ea-bd09-e7ac3b1e7833 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:03.183649 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-377fcec6-9408-43ea-bd09-e7ac3b1e7833 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:03.184427 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-377fcec6-9408-43ea-bd09-e7ac3b1e7833 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:03.184851 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-377fcec6-9408-43ea-bd09-e7ac3b1e7833 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:03.387248 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-377fcec6-9408-43ea-bd09-e7ac3b1e7833 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:03.402199 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-377fcec6-9408-43ea-bd09-e7ac3b1e7833 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:03.405548 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-377fcec6-9408-43ea-bd09-e7ac3b1e7833 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:03.407105 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-377fcec6-9408-43ea-bd09-e7ac3b1e7833 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54" status: 200 len: 1745 microversion: 2.20 time: 0.240936 Jul 22 11:18:03.408066 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 240/476] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:18:03 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 => generated 1745 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:18:04.091156 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-860b5be9-bb10-4876-96c8-8f7be6bd2173 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:04.102027 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-860b5be9-bb10-4876-96c8-8f7be6bd2173 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: d50614d9-5b91-43b0-952b-d5ecc987e85a] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:04.116607 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-860b5be9-bb10-4876-96c8-8f7be6bd2173 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:04.117126 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-860b5be9-bb10-4876-96c8-8f7be6bd2173 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:04.118009 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-860b5be9-bb10-4876-96c8-8f7be6bd2173 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:04.118449 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-860b5be9-bb10-4876-96c8-8f7be6bd2173 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:04.140749 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.wsgi [None req-860b5be9-bb10-4876-96c8-8f7be6bd2173 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] HTTP exception thrown: Instance d50614d9-5b91-43b0-952b-d5ecc987e85a could not be found. Jul 22 11:18:04.144018 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-860b5be9-bb10-4876-96c8-8f7be6bd2173 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Request method failure captured: Jul 22 11:18:04.144018 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: request: GET /compute/v2.1/servers/d50614d9-5b91-43b0-952b-d5ecc987e85a HTTP/1.1 Jul 22 11:18:04.144018 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Accept: application/json Jul 22 11:18:04.144018 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Accept-Encoding: identity Jul 22 11:18:04.144018 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Connection: close Jul 22 11:18:04.144018 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Content-Length: 0 Jul 22 11:18:04.144018 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Content-Type: application/json Jul 22 11:18:04.144018 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Host: 10.222.0.20 Jul 22 11:18:04.144018 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Openstack-System-Scope: None Jul 22 11:18:04.144018 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: User-Agent: python-urllib3/1.26.9 Jul 22 11:18:04.144018 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Auth-Token: gAAAAABi2oZ52By6vC80uVvQ5nsWGLE19ZXI57S3ld1fjPibH8fuUYjCV8gJDPh42GzMe4RKMojTgGaj2CCjG1yohpK4Rm5k-mOJAFOmJU-P2lN4F8UiP8lUppBYVH0uVfdef6vJD72z_c72VmeWRwsVQhXxsOTWQe5Gh1G1aCThgwUg9CYgRRw Jul 22 11:18:04.144018 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Domain-Id: None Jul 22 11:18:04.144018 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Domain-Name: None Jul 22 11:18:04.144018 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Identity-Status: Confirmed Jul 22 11:18:04.144018 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Is-Admin-Project: True Jul 22 11:18:04.144018 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Domain-Id: default Jul 22 11:18:04.144018 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Domain-Name: Default Jul 22 11:18:04.144018 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Id: 28836b7cb9c646aaaa1bb1c1fae68128 Jul 22 11:18:04.144018 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Name: tempest-AttachVolumeNegativeTest-1017563372 Jul 22 11:18:04.144018 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Role: reader,member Jul 22 11:18:04.144018 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Roles: reader,member Jul 22 11:18:04.146675 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/28836b7cb9c646aaaa1bb1c1fae68128"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_28836b7cb9c646aaaa1bb1c1fae68128", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/28836b7cb9c646aaaa1bb1c1fae68128"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/28836b7cb9c646aaaa1bb1c1fae68128"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jul 22 11:18:04.146675 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant: tempest-AttachVolumeNegativeTest-1017563372 Jul 22 11:18:04.146675 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant-Id: 28836b7cb9c646aaaa1bb1c1fae68128 Jul 22 11:18:04.146675 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1017563372 Jul 22 11:18:04.146675 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User: tempest-AttachVolumeNegativeTest-1017563372-project Jul 22 11:18:04.146675 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Domain-Id: default Jul 22 11:18:04.146675 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Domain-Name: Default Jul 22 11:18:04.146675 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Id: 691877dce1024aeda61629073d74602b Jul 22 11:18:04.146675 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Name: tempest-AttachVolumeNegativeTest-1017563372-project Jul 22 11:18:04.146675 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: method: > Jul 22 11:18:04.146675 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: exception: Instance d50614d9-5b91-43b0-952b-d5ecc987e85a could not be found. Jul 22 11:18:04.146675 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: action_args: {'id': 'd50614d9-5b91-43b0-952b-d5ecc987e85a'} Jul 22 11:18:04.152497 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 22 11:18:04.152497 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:18:04.152497 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 22 11:18:04.152497 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 22 11:18:04.152497 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 22 11:18:04.152497 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 22 11:18:04.152497 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 22 11:18:04.152497 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 22 11:18:04.152497 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 22 11:18:04.152497 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 22 11:18:04.152497 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d50614d9-5b91-43b0-952b-d5ecc987e85a could not be found. Jul 22 11:18:04.152497 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:18:04.152497 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:18:04.152497 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:18:04.152497 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:18:04.152497 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:18:04.152497 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:18:04.152497 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 22 11:18:04.152497 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 22 11:18:04.152497 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 22 11:18:04.153929 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 22 11:18:04.153929 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 22 11:18:04.153929 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 22 11:18:04.153929 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 22 11:18:04.153929 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 22 11:18:04.153929 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 22 11:18:04.153929 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 22 11:18:04.153929 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d50614d9-5b91-43b0-952b-d5ecc987e85a could not be found. Jul 22 11:18:04.153929 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:18:04.153929 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:18:04.153929 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:18:04.153929 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:18:04.153929 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:18:04.153929 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:18:04.153929 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 22 11:18:04.153929 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 22 11:18:04.153929 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d50614d9-5b91-43b0-952b-d5ecc987e85a could not be found. Jul 22 11:18:04.153929 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:18:04.155203 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-860b5be9-bb10-4876-96c8-8f7be6bd2173 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Returning 404 to user: Instance d50614d9-5b91-43b0-952b-d5ecc987e85a could not be found. {{(pid=117884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 22 11:18:04.155203 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-860b5be9-bb10-4876-96c8-8f7be6bd2173 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/d50614d9-5b91-43b0-952b-d5ecc987e85a" status: 404 len: 111 microversion: 2.1 time: 0.059324 Jul 22 11:18:04.155203 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 237/477] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:04 2022] GET /compute/v2.1/servers/d50614d9-5b91-43b0-952b-d5ecc987e85a => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 22 11:18:04.160050 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-864c72a1-0765-4cbe-a436-341fb10c4c64 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '.version_select at 0x7f84451b8af0>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:04.188536 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-20c530b7-438a-4f7c-8ea2-5cc5dd1e005a tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:04.189492 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-20c530b7-438a-4f7c-8ea2-5cc5dd1e005a tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] [instance: 39fe8666-e4cc-464c-9af9-bd43835bccf6] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:04.196888 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-20c530b7-438a-4f7c-8ea2-5cc5dd1e005a tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:04.197914 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-20c530b7-438a-4f7c-8ea2-5cc5dd1e005a tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:04.198710 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-20c530b7-438a-4f7c-8ea2-5cc5dd1e005a tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:04.202155 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-20c530b7-438a-4f7c-8ea2-5cc5dd1e005a tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:04.207156 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-864c72a1-0765-4cbe-a436-341fb10c4c64 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-977198902" status: 202 len: 0 microversion: 2.1 time: 0.052271 Jul 22 11:18:04.208893 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 241/478] 10.222.0.20 () {58 vars in 1217 bytes} [Fri Jul 22 11:18:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-977198902 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 22 11:18:04.429610 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-e3aaa36e-df5e-4ead-a5fe-7b388ac7cf3b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:04.430398 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-e3aaa36e-df5e-4ead-a5fe-7b388ac7cf3b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:04.440507 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e3aaa36e-df5e-4ead-a5fe-7b388ac7cf3b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:04.440965 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e3aaa36e-df5e-4ead-a5fe-7b388ac7cf3b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:04.442394 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e3aaa36e-df5e-4ead-a5fe-7b388ac7cf3b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:04.442837 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e3aaa36e-df5e-4ead-a5fe-7b388ac7cf3b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:04.465093 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-20c530b7-438a-4f7c-8ea2-5cc5dd1e005a tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e908d2b09dfc4a139d9c27f52580e15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84fa2f397c54be1b409d8be5ebc8491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:04.474205 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-20c530b7-438a-4f7c-8ea2-5cc5dd1e005a tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] 10.222.0.20 "GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6" status: 200 len: 1755 microversion: 2.1 time: 0.305279 Jul 22 11:18:04.483045 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:18:04.485073 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 238/479] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:04 2022] GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6 => generated 1755 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:18:04.679010 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-e3aaa36e-df5e-4ead-a5fe-7b388ac7cf3b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:04.688736 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-e3aaa36e-df5e-4ead-a5fe-7b388ac7cf3b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:04.690314 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-e3aaa36e-df5e-4ead-a5fe-7b388ac7cf3b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:04.691713 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-e3aaa36e-df5e-4ead-a5fe-7b388ac7cf3b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54" status: 200 len: 1745 microversion: 2.20 time: 0.267751 Jul 22 11:18:04.692311 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 242/480] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:18:04 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 => generated 1745 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 22 11:18:05.229402 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-cd41a9f3-c36f-42df-bc69-cf43affb5b25 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:05.230313 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-cd41a9f3-c36f-42df-bc69-cf43affb5b25 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 0501f722-7553-4cba-9675-7bcbabb72887] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:05.244754 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-cd41a9f3-c36f-42df-bc69-cf43affb5b25 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:05.244754 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-cd41a9f3-c36f-42df-bc69-cf43affb5b25 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:05.245813 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-cd41a9f3-c36f-42df-bc69-cf43affb5b25 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:05.246544 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-cd41a9f3-c36f-42df-bc69-cf43affb5b25 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:05.389896 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.objects.instance [None req-cd41a9f3-c36f-42df-bc69-cf43affb5b25 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lazy-loading 'services' on Instance uuid 0501f722-7553-4cba-9675-7bcbabb72887 {{(pid=117884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 22 11:18:05.495889 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-8615fad3-0e6d-49e9-bc8f-9b865535287f tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:05.497255 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-8615fad3-0e6d-49e9-bc8f-9b865535287f tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] [instance: 39fe8666-e4cc-464c-9af9-bd43835bccf6] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:05.505386 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8615fad3-0e6d-49e9-bc8f-9b865535287f tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:05.505846 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8615fad3-0e6d-49e9-bc8f-9b865535287f tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:05.506610 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8615fad3-0e6d-49e9-bc8f-9b865535287f tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:05.507074 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8615fad3-0e6d-49e9-bc8f-9b865535287f tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:05.523857 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-cd41a9f3-c36f-42df-bc69-cf43affb5b25 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887/os-volume_attachments/c991934f-a2a3-4c93-b91f-c324e9fc433e" status: 202 len: 0 microversion: 2.1 time: 0.301266 Jul 22 11:18:05.524455 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 239/481] 10.222.0.20 () {58 vars in 1415 bytes} [Fri Jul 22 11:18:05 2022] DELETE /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887/os-volume_attachments/c991934f-a2a3-4c93-b91f-c324e9fc433e => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 22 11:18:05.538814 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-67d40e1f-f997-4e0d-a1b5-738ae20ca569 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:05.540287 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-67d40e1f-f997-4e0d-a1b5-738ae20ca569 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 0501f722-7553-4cba-9675-7bcbabb72887] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:05.548036 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-67d40e1f-f997-4e0d-a1b5-738ae20ca569 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:05.549200 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-67d40e1f-f997-4e0d-a1b5-738ae20ca569 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:05.550534 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-67d40e1f-f997-4e0d-a1b5-738ae20ca569 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:05.551174 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-67d40e1f-f997-4e0d-a1b5-738ae20ca569 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:05.590697 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-67d40e1f-f997-4e0d-a1b5-738ae20ca569 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058810 Jul 22 11:18:05.595843 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 240/482] 10.222.0.20 () {58 vars in 1301 bytes} [Fri Jul 22 11:18:05 2022] GET /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 22 11:18:05.713371 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-00836f7c-5e1b-493e-87f0-cf6eed32430c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:05.714100 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-00836f7c-5e1b-493e-87f0-cf6eed32430c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:05.720881 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-00836f7c-5e1b-493e-87f0-cf6eed32430c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:05.721598 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-00836f7c-5e1b-493e-87f0-cf6eed32430c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:05.722883 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-00836f7c-5e1b-493e-87f0-cf6eed32430c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:05.723585 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-00836f7c-5e1b-493e-87f0-cf6eed32430c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:05.732280 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-8615fad3-0e6d-49e9-bc8f-9b865535287f tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e908d2b09dfc4a139d9c27f52580e15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84fa2f397c54be1b409d8be5ebc8491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:05.742256 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-8615fad3-0e6d-49e9-bc8f-9b865535287f tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] 10.222.0.20 "GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6" status: 200 len: 1755 microversion: 2.1 time: 0.253067 Jul 22 11:18:05.743651 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 243/483] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:05 2022] GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6 => generated 1755 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:18:05.881321 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-00836f7c-5e1b-493e-87f0-cf6eed32430c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:05.889636 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-00836f7c-5e1b-493e-87f0-cf6eed32430c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:05.891128 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-00836f7c-5e1b-493e-87f0-cf6eed32430c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:05.892313 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-00836f7c-5e1b-493e-87f0-cf6eed32430c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54" status: 200 len: 1745 microversion: 2.20 time: 0.183553 Jul 22 11:18:05.892868 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 241/484] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:18:05 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 => generated 1745 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 22 11:18:06.607235 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-2ca6d823-2dd0-415b-9fa2-f43efba07580 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:06.608253 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-2ca6d823-2dd0-415b-9fa2-f43efba07580 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 0501f722-7553-4cba-9675-7bcbabb72887] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:06.617675 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2ca6d823-2dd0-415b-9fa2-f43efba07580 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:06.617675 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2ca6d823-2dd0-415b-9fa2-f43efba07580 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:06.617675 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2ca6d823-2dd0-415b-9fa2-f43efba07580 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:06.617675 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2ca6d823-2dd0-415b-9fa2-f43efba07580 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:06.688313 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-2ca6d823-2dd0-415b-9fa2-f43efba07580 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.084914 Jul 22 11:18:06.690095 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 244/485] 10.222.0.20 () {58 vars in 1301 bytes} [Fri Jul 22 11:18:06 2022] GET /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887/os-volume_attachments => generated 25 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 22 11:18:06.760908 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-f38884e0-51f5-4b17-8e93-12840b89ce58 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:06.762095 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-f38884e0-51f5-4b17-8e93-12840b89ce58 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 0501f722-7553-4cba-9675-7bcbabb72887] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:06.769435 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-4f72db82-93b1-4ca2-b7f0-31a08761fc31 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:06.770557 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-4f72db82-93b1-4ca2-b7f0-31a08761fc31 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] [instance: 39fe8666-e4cc-464c-9af9-bd43835bccf6] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:06.771775 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f38884e0-51f5-4b17-8e93-12840b89ce58 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:06.773185 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f38884e0-51f5-4b17-8e93-12840b89ce58 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:06.774904 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f38884e0-51f5-4b17-8e93-12840b89ce58 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:06.775791 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f38884e0-51f5-4b17-8e93-12840b89ce58 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:06.781786 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4f72db82-93b1-4ca2-b7f0-31a08761fc31 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:06.782518 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4f72db82-93b1-4ca2-b7f0-31a08761fc31 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:06.783344 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4f72db82-93b1-4ca2-b7f0-31a08761fc31 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:06.783788 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4f72db82-93b1-4ca2-b7f0-31a08761fc31 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:06.813886 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-f38884e0-51f5-4b17-8e93-12840b89ce58 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 0501f722-7553-4cba-9675-7bcbabb72887] Going to try to terminate instance {{(pid=117884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 22 11:18:06.930893 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-f38884e0-51f5-4b17-8e93-12840b89ce58 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887" status: 204 len: 0 microversion: 2.1 time: 0.176622 Jul 22 11:18:06.932136 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 242/486] 10.222.0.20 () {58 vars in 1238 bytes} [Fri Jul 22 11:18:06 2022] DELETE /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 22 11:18:06.942506 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-57e4d8f8-d964-48e2-876d-63ba16327620 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:06.943592 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-57e4d8f8-d964-48e2-876d-63ba16327620 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:06.958660 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-57e4d8f8-d964-48e2-876d-63ba16327620 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:06.959458 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-57e4d8f8-d964-48e2-876d-63ba16327620 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:06.960447 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-57e4d8f8-d964-48e2-876d-63ba16327620 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:06.961047 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-57e4d8f8-d964-48e2-876d-63ba16327620 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:07.029601 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-4f72db82-93b1-4ca2-b7f0-31a08761fc31 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e908d2b09dfc4a139d9c27f52580e15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84fa2f397c54be1b409d8be5ebc8491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:07.039318 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-4f72db82-93b1-4ca2-b7f0-31a08761fc31 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] 10.222.0.20 "GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6" status: 200 len: 1755 microversion: 2.1 time: 0.280813 Jul 22 11:18:07.039939 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 245/487] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:06 2022] GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6 => generated 1755 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:18:07.055143 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-9c54e231-4eb5-4aa1-8d60-3fc1aab6c35a tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:07.055957 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-9c54e231-4eb5-4aa1-8d60-3fc1aab6c35a tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 0501f722-7553-4cba-9675-7bcbabb72887] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:07.064005 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9c54e231-4eb5-4aa1-8d60-3fc1aab6c35a tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:07.064456 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9c54e231-4eb5-4aa1-8d60-3fc1aab6c35a tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:07.065349 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9c54e231-4eb5-4aa1-8d60-3fc1aab6c35a tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:07.065798 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9c54e231-4eb5-4aa1-8d60-3fc1aab6c35a tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:07.200117 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-57e4d8f8-d964-48e2-876d-63ba16327620 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:07.210786 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-57e4d8f8-d964-48e2-876d-63ba16327620 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:07.213148 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-57e4d8f8-d964-48e2-876d-63ba16327620 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:07.214692 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-57e4d8f8-d964-48e2-876d-63ba16327620 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54" status: 200 len: 1740 microversion: 2.20 time: 0.279017 Jul 22 11:18:07.215740 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 243/488] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:18:06 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 => generated 1740 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:18:07.222915 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [req-40f81c8e-c105-4743-9229-3e851f0301c5 req-48938df7-cc99-4f96-b918-0a8c5e9d0017 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f27dab8-c005-4dd0-b262-542deb60dd54", "name": "network-vif-plugged", "status": "completed", "tag": "019d06a1-2c6e-4ebb-b1f0-a080fc8a2fef"}]} {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:18:07.235925 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-40f81c8e-c105-4743-9229-3e851f0301c5 req-48938df7-cc99-4f96-b918-0a8c5e9d0017 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:07.237358 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-40f81c8e-c105-4743-9229-3e851f0301c5 req-48938df7-cc99-4f96-b918-0a8c5e9d0017 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:07.255149 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.compute.server_external_events [req-40f81c8e-c105-4743-9229-3e851f0301c5 req-48938df7-cc99-4f96-b918-0a8c5e9d0017 service nova] Creating event network-vif-plugged:019d06a1-2c6e-4ebb-b1f0-a080fc8a2fef for instance 1f27dab8-c005-4dd0-b262-542deb60dd54 on hv-cinder-84890 Jul 22 11:18:07.266638 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [req-40f81c8e-c105-4743-9229-3e851f0301c5 req-48938df7-cc99-4f96-b918-0a8c5e9d0017 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048878 Jul 22 11:18:07.267608 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 244/489] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:18:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:18:07.298822 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-9c54e231-4eb5-4aa1-8d60-3fc1aab6c35a tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:07.311547 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-9c54e231-4eb5-4aa1-8d60-3fc1aab6c35a tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887" status: 200 len: 1682 microversion: 2.1 time: 0.260784 Jul 22 11:18:07.312488 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 246/490] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:07 2022] GET /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887 => generated 1682 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:18:08.063046 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-dc6cf3d8-eff7-471d-8ec7-4ec31b124c9e tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:08.063947 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-dc6cf3d8-eff7-471d-8ec7-4ec31b124c9e tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] [instance: 39fe8666-e4cc-464c-9af9-bd43835bccf6] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:08.072079 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-dc6cf3d8-eff7-471d-8ec7-4ec31b124c9e tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:08.072922 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-dc6cf3d8-eff7-471d-8ec7-4ec31b124c9e tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:08.074012 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-dc6cf3d8-eff7-471d-8ec7-4ec31b124c9e tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:08.074702 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-dc6cf3d8-eff7-471d-8ec7-4ec31b124c9e tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:08.238772 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-b7f1d0e3-a9ff-4c54-843b-d3906df97747 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:08.241271 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-b7f1d0e3-a9ff-4c54-843b-d3906df97747 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:08.255299 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b7f1d0e3-a9ff-4c54-843b-d3906df97747 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:08.255775 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b7f1d0e3-a9ff-4c54-843b-d3906df97747 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:08.256697 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b7f1d0e3-a9ff-4c54-843b-d3906df97747 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:08.257304 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b7f1d0e3-a9ff-4c54-843b-d3906df97747 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:08.345873 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-dc6cf3d8-eff7-471d-8ec7-4ec31b124c9e tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e908d2b09dfc4a139d9c27f52580e15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84fa2f397c54be1b409d8be5ebc8491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:08.356046 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-dc6cf3d8-eff7-471d-8ec7-4ec31b124c9e tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] 10.222.0.20 "GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6" status: 200 len: 1755 microversion: 2.1 time: 0.301628 Jul 22 11:18:08.357196 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 245/491] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:08 2022] GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6 => generated 1755 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:18:08.365152 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-4c4bee21-4dfa-4f77-a5e0-bab35408ef58 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:08.365946 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-4c4bee21-4dfa-4f77-a5e0-bab35408ef58 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 0501f722-7553-4cba-9675-7bcbabb72887] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:08.373636 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-4c4bee21-4dfa-4f77-a5e0-bab35408ef58 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:08.374381 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-4c4bee21-4dfa-4f77-a5e0-bab35408ef58 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:08.375882 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-4c4bee21-4dfa-4f77-a5e0-bab35408ef58 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:08.376523 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-4c4bee21-4dfa-4f77-a5e0-bab35408ef58 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:08.563018 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-b7f1d0e3-a9ff-4c54-843b-d3906df97747 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:08.582019 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-b7f1d0e3-a9ff-4c54-843b-d3906df97747 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:08.587293 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-b7f1d0e3-a9ff-4c54-843b-d3906df97747 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:08.590005 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-b7f1d0e3-a9ff-4c54-843b-d3906df97747 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54" status: 200 len: 1740 microversion: 2.20 time: 0.355395 Jul 22 11:18:08.607611 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 247/492] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:18:08 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 => generated 1740 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:18:08.649060 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-4c4bee21-4dfa-4f77-a5e0-bab35408ef58 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:08.662947 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-4c4bee21-4dfa-4f77-a5e0-bab35408ef58 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887" status: 200 len: 1682 microversion: 2.1 time: 0.303804 Jul 22 11:18:08.664064 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 246/493] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:08 2022] GET /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887 => generated 1682 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:18:09.383069 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-51386517-c67f-4efa-a851-c7be4fd10b9e tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:09.385843 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-51386517-c67f-4efa-a851-c7be4fd10b9e tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] [instance: 39fe8666-e4cc-464c-9af9-bd43835bccf6] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:09.397374 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-51386517-c67f-4efa-a851-c7be4fd10b9e tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:09.398554 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-51386517-c67f-4efa-a851-c7be4fd10b9e tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:09.400293 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-51386517-c67f-4efa-a851-c7be4fd10b9e tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:09.401371 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-51386517-c67f-4efa-a851-c7be4fd10b9e tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:09.616904 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-51386517-c67f-4efa-a851-c7be4fd10b9e tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e908d2b09dfc4a139d9c27f52580e15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84fa2f397c54be1b409d8be5ebc8491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:09.633983 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-51386517-c67f-4efa-a851-c7be4fd10b9e tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] 10.222.0.20 "GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6" status: 200 len: 1755 microversion: 2.1 time: 0.256808 Jul 22 11:18:09.634902 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-846e5a12-65a6-4376-8c90-43bed062b6fa tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:09.636688 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-846e5a12-65a6-4376-8c90-43bed062b6fa tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:09.637555 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 248/494] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:09 2022] GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6 => generated 1755 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:18:09.667644 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-846e5a12-65a6-4376-8c90-43bed062b6fa tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:09.669137 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-846e5a12-65a6-4376-8c90-43bed062b6fa tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:09.670797 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-846e5a12-65a6-4376-8c90-43bed062b6fa tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:09.672041 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-846e5a12-65a6-4376-8c90-43bed062b6fa tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:09.683696 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-3294cb9a-730e-48b1-8328-1a45f1391381 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:09.684801 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-3294cb9a-730e-48b1-8328-1a45f1391381 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 0501f722-7553-4cba-9675-7bcbabb72887] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:09.710927 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3294cb9a-730e-48b1-8328-1a45f1391381 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:09.711739 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3294cb9a-730e-48b1-8328-1a45f1391381 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:09.713148 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3294cb9a-730e-48b1-8328-1a45f1391381 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:09.713846 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3294cb9a-730e-48b1-8328-1a45f1391381 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:09.898240 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-846e5a12-65a6-4376-8c90-43bed062b6fa tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:09.910402 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-846e5a12-65a6-4376-8c90-43bed062b6fa tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:09.910402 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-846e5a12-65a6-4376-8c90-43bed062b6fa tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:09.910402 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-846e5a12-65a6-4376-8c90-43bed062b6fa tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54" status: 200 len: 1740 microversion: 2.20 time: 0.284176 Jul 22 11:18:09.922006 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 247/495] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:18:09 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 => generated 1740 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 22 11:18:10.060065 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-3294cb9a-730e-48b1-8328-1a45f1391381 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:10.079323 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-3294cb9a-730e-48b1-8328-1a45f1391381 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887" status: 200 len: 1682 microversion: 2.1 time: 0.395625 Jul 22 11:18:10.079323 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 249/496] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:09 2022] GET /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887 => generated 1682 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:18:10.673433 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-dacae887-94a9-42ed-a6c0-5a5437f629dd tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:10.679671 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-dacae887-94a9-42ed-a6c0-5a5437f629dd tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] [instance: 39fe8666-e4cc-464c-9af9-bd43835bccf6] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:10.704741 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-dacae887-94a9-42ed-a6c0-5a5437f629dd tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:10.705844 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-dacae887-94a9-42ed-a6c0-5a5437f629dd tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:10.706736 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-dacae887-94a9-42ed-a6c0-5a5437f629dd tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:10.707736 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-dacae887-94a9-42ed-a6c0-5a5437f629dd tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:10.930998 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-ac1ef1f1-dfaf-4214-b739-a33f3bf4e404 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:10.935501 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-ac1ef1f1-dfaf-4214-b739-a33f3bf4e404 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:10.945826 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ac1ef1f1-dfaf-4214-b739-a33f3bf4e404 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:10.946598 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ac1ef1f1-dfaf-4214-b739-a33f3bf4e404 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:10.947966 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ac1ef1f1-dfaf-4214-b739-a33f3bf4e404 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:10.948861 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ac1ef1f1-dfaf-4214-b739-a33f3bf4e404 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:11.013761 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-dacae887-94a9-42ed-a6c0-5a5437f629dd tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e908d2b09dfc4a139d9c27f52580e15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84fa2f397c54be1b409d8be5ebc8491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:11.031062 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-dacae887-94a9-42ed-a6c0-5a5437f629dd tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] 10.222.0.20 "GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6" status: 200 len: 1755 microversion: 2.1 time: 0.365082 Jul 22 11:18:11.048727 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 248/497] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:10 2022] GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6 => generated 1755 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:18:11.096974 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-322c35bd-1036-4000-8191-dc2aaeb83a38 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:11.097894 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-322c35bd-1036-4000-8191-dc2aaeb83a38 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 0501f722-7553-4cba-9675-7bcbabb72887] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:11.125661 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-322c35bd-1036-4000-8191-dc2aaeb83a38 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:11.127505 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-322c35bd-1036-4000-8191-dc2aaeb83a38 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:11.129609 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-322c35bd-1036-4000-8191-dc2aaeb83a38 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:11.133150 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-322c35bd-1036-4000-8191-dc2aaeb83a38 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:11.312680 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-322c35bd-1036-4000-8191-dc2aaeb83a38 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:11.328626 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-322c35bd-1036-4000-8191-dc2aaeb83a38 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887" status: 200 len: 1615 microversion: 2.1 time: 0.238448 Jul 22 11:18:11.343480 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 249/498] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:11 2022] GET /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887 => generated 1615 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:18:11.350318 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-4f9050ac-f5bb-431e-9f73-23323b0a66bc tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "97e32901-9964-4317-840e-1d0bc7be9091"}} {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:18:11.352327 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-4f9050ac-f5bb-431e-9f73-23323b0a66bc tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 6d50352a-fd4f-4ca5-8e13-2519dfbb66a1] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:11.363654 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-4f9050ac-f5bb-431e-9f73-23323b0a66bc tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:11.365532 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-4f9050ac-f5bb-431e-9f73-23323b0a66bc tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:11.367457 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-4f9050ac-f5bb-431e-9f73-23323b0a66bc tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:11.368331 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-4f9050ac-f5bb-431e-9f73-23323b0a66bc tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:11.378596 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-ac1ef1f1-dfaf-4214-b739-a33f3bf4e404 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:11.388702 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-ac1ef1f1-dfaf-4214-b739-a33f3bf4e404 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:11.390293 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-ac1ef1f1-dfaf-4214-b739-a33f3bf4e404 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:11.410676 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-ac1ef1f1-dfaf-4214-b739-a33f3bf4e404 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54" status: 200 len: 1740 microversion: 2.20 time: 0.484546 Jul 22 11:18:11.412166 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 250/499] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:18:10 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 => generated 1740 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 22 11:18:11.432079 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-6aa36528-0af1-490b-bdc7-51afc0ab6098 req-fc13e637-03ed-4033-ba85-fc9d02672a7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0501f722-7553-4cba-9675-7bcbabb72887", "name": "network-vif-deleted", "tag": "3c9a61a2-8eae-42fd-91d8-ee04df69941e"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:18:11.453323 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-6aa36528-0af1-490b-bdc7-51afc0ab6098 req-fc13e637-03ed-4033-ba85-fc9d02672a7b service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:11.454066 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-6aa36528-0af1-490b-bdc7-51afc0ab6098 req-fc13e637-03ed-4033-ba85-fc9d02672a7b service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:11.487914 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-6aa36528-0af1-490b-bdc7-51afc0ab6098 req-fc13e637-03ed-4033-ba85-fc9d02672a7b service nova] Creating event network-vif-deleted:3c9a61a2-8eae-42fd-91d8-ee04df69941e for instance 0501f722-7553-4cba-9675-7bcbabb72887 on hv-cinder-84890 Jul 22 11:18:11.504231 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-6aa36528-0af1-490b-bdc7-51afc0ab6098 req-fc13e637-03ed-4033-ba85-fc9d02672a7b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076378 Jul 22 11:18:11.506013 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 251/500] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:18:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 22 11:18:11.517334 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG dbcounter [-] [117884] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:18:11.918384 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-4f9050ac-f5bb-431e-9f73-23323b0a66bc tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "POST /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.571948 Jul 22 11:18:11.921632 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 250/501] 10.222.0.20 () {60 vars in 1322 bytes} [Fri Jul 22 11:18:11 2022] POST /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1/os-volume_attachments => generated 194 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:18:12.060049 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-1264f49f-3e3e-435a-88db-320e2496195f tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:12.061415 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-1264f49f-3e3e-435a-88db-320e2496195f tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] [instance: 39fe8666-e4cc-464c-9af9-bd43835bccf6] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:12.068849 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1264f49f-3e3e-435a-88db-320e2496195f tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:12.069283 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1264f49f-3e3e-435a-88db-320e2496195f tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:12.070270 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1264f49f-3e3e-435a-88db-320e2496195f tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:12.070694 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1264f49f-3e3e-435a-88db-320e2496195f tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:12.350747 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-e1288aab-764b-49ae-9b90-bda1fa19163f tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:12.351651 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-e1288aab-764b-49ae-9b90-bda1fa19163f tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 0501f722-7553-4cba-9675-7bcbabb72887] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:12.352272 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-1264f49f-3e3e-435a-88db-320e2496195f tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e908d2b09dfc4a139d9c27f52580e15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84fa2f397c54be1b409d8be5ebc8491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:12.370183 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-1264f49f-3e3e-435a-88db-320e2496195f tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] 10.222.0.20 "GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6" status: 200 len: 1755 microversion: 2.1 time: 0.314955 Jul 22 11:18:12.371482 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 252/502] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:12 2022] GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6 => generated 1755 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:18:12.381566 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-e1288aab-764b-49ae-9b90-bda1fa19163f tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:12.382399 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-e1288aab-764b-49ae-9b90-bda1fa19163f tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:12.383470 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-e1288aab-764b-49ae-9b90-bda1fa19163f tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:12.383593 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-e1288aab-764b-49ae-9b90-bda1fa19163f tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:12.440971 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-e1288aab-764b-49ae-9b90-bda1fa19163f tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:12.441492 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-e1288aab-764b-49ae-9b90-bda1fa19163f tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:12.441977 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.objects.instance [None req-e1288aab-764b-49ae-9b90-bda1fa19163f tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lazy-loading 'fault' on Instance uuid 0501f722-7553-4cba-9675-7bcbabb72887 {{(pid=117884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 22 11:18:12.452318 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-5c068933-c777-4b92-936b-53a42c05614c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:12.452949 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-5c068933-c777-4b92-936b-53a42c05614c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:12.479723 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5c068933-c777-4b92-936b-53a42c05614c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:12.483121 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5c068933-c777-4b92-936b-53a42c05614c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:12.483988 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5c068933-c777-4b92-936b-53a42c05614c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:12.484432 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5c068933-c777-4b92-936b-53a42c05614c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:12.523941 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-e1288aab-764b-49ae-9b90-bda1fa19163f tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:12.565221 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-e1288aab-764b-49ae-9b90-bda1fa19163f tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887" status: 200 len: 1331 microversion: 2.1 time: 0.218439 Jul 22 11:18:12.581292 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 251/503] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:12 2022] GET /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887 => generated 1331 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:18:12.777162 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-5c068933-c777-4b92-936b-53a42c05614c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:12.790926 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-5c068933-c777-4b92-936b-53a42c05614c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:12.793036 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-5c068933-c777-4b92-936b-53a42c05614c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:12.794955 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-5c068933-c777-4b92-936b-53a42c05614c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54" status: 200 len: 1740 microversion: 2.20 time: 0.361708 Jul 22 11:18:12.796624 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 253/504] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:18:12 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 => generated 1740 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:18:13.401038 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-025b3fac-fdcc-4a20-86c2-8ab8005d0f08 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:13.401796 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-025b3fac-fdcc-4a20-86c2-8ab8005d0f08 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] [instance: 39fe8666-e4cc-464c-9af9-bd43835bccf6] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:13.413256 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-025b3fac-fdcc-4a20-86c2-8ab8005d0f08 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:13.413851 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-025b3fac-fdcc-4a20-86c2-8ab8005d0f08 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:13.416092 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-025b3fac-fdcc-4a20-86c2-8ab8005d0f08 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:13.416092 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-025b3fac-fdcc-4a20-86c2-8ab8005d0f08 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:13.592796 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-4d001c41-06e0-4644-9e08-3980f6c867b4 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:13.594095 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-4d001c41-06e0-4644-9e08-3980f6c867b4 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 0501f722-7553-4cba-9675-7bcbabb72887] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:13.608343 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4d001c41-06e0-4644-9e08-3980f6c867b4 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:13.609583 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4d001c41-06e0-4644-9e08-3980f6c867b4 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:13.610642 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4d001c41-06e0-4644-9e08-3980f6c867b4 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:13.611335 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4d001c41-06e0-4644-9e08-3980f6c867b4 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:13.628559 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.wsgi [None req-4d001c41-06e0-4644-9e08-3980f6c867b4 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] HTTP exception thrown: Instance 0501f722-7553-4cba-9675-7bcbabb72887 could not be found. Jul 22 11:18:13.631783 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-4d001c41-06e0-4644-9e08-3980f6c867b4 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Request method failure captured: Jul 22 11:18:13.631783 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: request: GET /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887 HTTP/1.1 Jul 22 11:18:13.631783 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Accept: application/json Jul 22 11:18:13.631783 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Accept-Encoding: identity Jul 22 11:18:13.631783 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Connection: close Jul 22 11:18:13.631783 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Content-Length: 0 Jul 22 11:18:13.631783 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Content-Type: application/json Jul 22 11:18:13.631783 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Host: 10.222.0.20 Jul 22 11:18:13.631783 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Openstack-System-Scope: None Jul 22 11:18:13.631783 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: User-Agent: python-urllib3/1.26.9 Jul 22 11:18:13.631783 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Auth-Token: gAAAAABi2oZ52By6vC80uVvQ5nsWGLE19ZXI57S3ld1fjPibH8fuUYjCV8gJDPh42GzMe4RKMojTgGaj2CCjG1yohpK4Rm5k-mOJAFOmJU-P2lN4F8UiP8lUppBYVH0uVfdef6vJD72z_c72VmeWRwsVQhXxsOTWQe5Gh1G1aCThgwUg9CYgRRw Jul 22 11:18:13.631783 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Domain-Id: None Jul 22 11:18:13.631783 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Domain-Name: None Jul 22 11:18:13.631783 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Identity-Status: Confirmed Jul 22 11:18:13.631783 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Is-Admin-Project: True Jul 22 11:18:13.631783 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Project-Domain-Id: default Jul 22 11:18:13.631783 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Project-Domain-Name: Default Jul 22 11:18:13.631783 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Project-Id: 28836b7cb9c646aaaa1bb1c1fae68128 Jul 22 11:18:13.631783 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Project-Name: tempest-AttachVolumeNegativeTest-1017563372 Jul 22 11:18:13.631783 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Role: reader,member Jul 22 11:18:13.631783 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Roles: reader,member Jul 22 11:18:13.633145 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/28836b7cb9c646aaaa1bb1c1fae68128"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_28836b7cb9c646aaaa1bb1c1fae68128", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/28836b7cb9c646aaaa1bb1c1fae68128"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/28836b7cb9c646aaaa1bb1c1fae68128"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jul 22 11:18:13.633145 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Tenant: tempest-AttachVolumeNegativeTest-1017563372 Jul 22 11:18:13.633145 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Tenant-Id: 28836b7cb9c646aaaa1bb1c1fae68128 Jul 22 11:18:13.633145 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1017563372 Jul 22 11:18:13.633145 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User: tempest-AttachVolumeNegativeTest-1017563372-project Jul 22 11:18:13.633145 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User-Domain-Id: default Jul 22 11:18:13.633145 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User-Domain-Name: Default Jul 22 11:18:13.633145 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User-Id: 691877dce1024aeda61629073d74602b Jul 22 11:18:13.633145 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User-Name: tempest-AttachVolumeNegativeTest-1017563372-project Jul 22 11:18:13.633145 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: method: > Jul 22 11:18:13.633145 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: exception: Instance 0501f722-7553-4cba-9675-7bcbabb72887 could not be found. Jul 22 11:18:13.633145 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: action_args: {'id': '0501f722-7553-4cba-9675-7bcbabb72887'} Jul 22 11:18:13.633921 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 22 11:18:13.633921 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:18:13.633921 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 22 11:18:13.633921 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 22 11:18:13.633921 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 22 11:18:13.633921 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 22 11:18:13.633921 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 22 11:18:13.633921 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 22 11:18:13.633921 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 22 11:18:13.633921 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 22 11:18:13.633921 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0501f722-7553-4cba-9675-7bcbabb72887 could not be found. Jul 22 11:18:13.633921 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:18:13.633921 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:18:13.633921 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:18:13.633921 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:18:13.633921 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:18:13.633921 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:18:13.633921 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 22 11:18:13.633921 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 22 11:18:13.633921 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 22 11:18:13.635697 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 22 11:18:13.635697 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 22 11:18:13.635697 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 22 11:18:13.635697 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 22 11:18:13.635697 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 22 11:18:13.635697 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 22 11:18:13.635697 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 22 11:18:13.635697 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0501f722-7553-4cba-9675-7bcbabb72887 could not be found. Jul 22 11:18:13.635697 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:18:13.635697 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:18:13.635697 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:18:13.635697 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:18:13.635697 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:18:13.635697 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:18:13.635697 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 22 11:18:13.635697 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 22 11:18:13.635697 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0501f722-7553-4cba-9675-7bcbabb72887 could not be found. Jul 22 11:18:13.635697 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:18:13.638470 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-4d001c41-06e0-4644-9e08-3980f6c867b4 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Returning 404 to user: Instance 0501f722-7553-4cba-9675-7bcbabb72887 could not be found. {{(pid=117885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 22 11:18:13.639616 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-4d001c41-06e0-4644-9e08-3980f6c867b4 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887" status: 404 len: 111 microversion: 2.1 time: 0.054270 Jul 22 11:18:13.645667 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 254/505] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:13 2022] GET /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 22 11:18:13.651758 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-bad5cf23-3a5a-4c21-bbe1-c047d850ed38 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '.version_select at 0x7f84451f1dc0>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:13.675341 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-025b3fac-fdcc-4a20-86c2-8ab8005d0f08 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e908d2b09dfc4a139d9c27f52580e15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84fa2f397c54be1b409d8be5ebc8491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:13.686046 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-025b3fac-fdcc-4a20-86c2-8ab8005d0f08 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] 10.222.0.20 "GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6" status: 200 len: 1755 microversion: 2.1 time: 0.290789 Jul 22 11:18:13.687297 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 252/506] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:13 2022] GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6 => generated 1755 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:18:13.703004 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-bad5cf23-3a5a-4c21-bbe1-c047d850ed38 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1251284060" status: 202 len: 0 microversion: 2.1 time: 0.055879 Jul 22 11:18:13.706990 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 255/507] 10.222.0.20 () {58 vars in 1220 bytes} [Fri Jul 22 11:18:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1251284060 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 22 11:18:13.817528 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-0f0fea1f-4f29-4b02-bf1f-44067336379b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:13.817779 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-0f0fea1f-4f29-4b02-bf1f-44067336379b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:13.827765 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-0f0fea1f-4f29-4b02-bf1f-44067336379b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:13.829690 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-0f0fea1f-4f29-4b02-bf1f-44067336379b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:13.832758 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-0f0fea1f-4f29-4b02-bf1f-44067336379b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:13.833315 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-0f0fea1f-4f29-4b02-bf1f-44067336379b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:14.164467 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-0f0fea1f-4f29-4b02-bf1f-44067336379b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:14.209188 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-0f0fea1f-4f29-4b02-bf1f-44067336379b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:14.216689 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-0f0fea1f-4f29-4b02-bf1f-44067336379b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:14.218609 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-0f0fea1f-4f29-4b02-bf1f-44067336379b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54" status: 200 len: 1740 microversion: 2.20 time: 0.406065 Jul 22 11:18:14.219323 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 253/508] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:18:13 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 => generated 1740 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:18:14.723726 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-23fc1f50-b799-4e16-ab0b-0bd50b70c7f2 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:14.727856 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-23fc1f50-b799-4e16-ab0b-0bd50b70c7f2 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] [instance: 39fe8666-e4cc-464c-9af9-bd43835bccf6] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:14.737538 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-23fc1f50-b799-4e16-ab0b-0bd50b70c7f2 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:14.738263 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-23fc1f50-b799-4e16-ab0b-0bd50b70c7f2 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:14.740331 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-23fc1f50-b799-4e16-ab0b-0bd50b70c7f2 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:14.741001 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-23fc1f50-b799-4e16-ab0b-0bd50b70c7f2 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:14.981495 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-23fc1f50-b799-4e16-ab0b-0bd50b70c7f2 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e908d2b09dfc4a139d9c27f52580e15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84fa2f397c54be1b409d8be5ebc8491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:15.011600 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-23fc1f50-b799-4e16-ab0b-0bd50b70c7f2 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] 10.222.0.20 "GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6" status: 200 len: 1755 microversion: 2.1 time: 0.306118 Jul 22 11:18:15.013453 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 256/509] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:14 2022] GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6 => generated 1755 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:18:15.089124 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-d7edfe8c-74b6-475e-880e-92704e58e933 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Action: 'create', calling method: .version_select at 0x7f844522cd30>, body: {"keypair": {"name": "tempest-keypair-1673128683", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF4GeVD/vzO9CFOjFkqIGaHjWE4nUydZ6C1nE7KkhUf+620vgbUpJ3YxHCb3sgqPo3YuI3YBmMozYAwKllvIOPK3sT7qhrxJj65xDJ0SuIKjgO/ttAOz2O0efOMRAmGGsQ=="}} {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:18:15.114758 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.quota [None req-d7edfe8c-74b6-475e-880e-92704e58e933 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Getting quotas for project 28836b7cb9c646aaaa1bb1c1fae68128. Resources: {'key_pairs'} {{(pid=117884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 22 11:18:15.121254 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.quota [None req-d7edfe8c-74b6-475e-880e-92704e58e933 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Getting quotas for user 691877dce1024aeda61629073d74602b and project 28836b7cb9c646aaaa1bb1c1fae68128. Resources: {'key_pairs'} {{(pid=117884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 22 11:18:15.197375 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-d7edfe8c-74b6-475e-880e-92704e58e933 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.115274 Jul 22 11:18:15.199347 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 254/510] 10.222.0.20 () {60 vars in 1158 bytes} [Fri Jul 22 11:18:15 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:18:15.241660 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-7e260d96-ba21-4579-bd11-0fe846cccb8c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:15.242176 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-7e260d96-ba21-4579-bd11-0fe846cccb8c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:15.248707 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_api:SELECT=67,nova_api:DELETE=2 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:18:15.250639 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7e260d96-ba21-4579-bd11-0fe846cccb8c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:15.251344 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7e260d96-ba21-4579-bd11-0fe846cccb8c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:15.252453 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7e260d96-ba21-4579-bd11-0fe846cccb8c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:15.253169 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7e260d96-ba21-4579-bd11-0fe846cccb8c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:15.525249 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-7e260d96-ba21-4579-bd11-0fe846cccb8c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:15.541376 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-7e260d96-ba21-4579-bd11-0fe846cccb8c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:15.542956 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-7e260d96-ba21-4579-bd11-0fe846cccb8c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:15.544269 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-7e260d96-ba21-4579-bd11-0fe846cccb8c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54" status: 200 len: 1740 microversion: 2.20 time: 0.311020 Jul 22 11:18:15.557689 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 257/511] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:18:15 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 => generated 1740 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:18:16.044179 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-0dae400d-f2a1-488a-92a3-9b7189bda075 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:16.044939 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-0dae400d-f2a1-488a-92a3-9b7189bda075 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] [instance: 39fe8666-e4cc-464c-9af9-bd43835bccf6] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:16.052571 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-0dae400d-f2a1-488a-92a3-9b7189bda075 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:16.053029 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-0dae400d-f2a1-488a-92a3-9b7189bda075 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:16.053860 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-0dae400d-f2a1-488a-92a3-9b7189bda075 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:16.054363 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-0dae400d-f2a1-488a-92a3-9b7189bda075 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:16.346625 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-0dae400d-f2a1-488a-92a3-9b7189bda075 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e908d2b09dfc4a139d9c27f52580e15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84fa2f397c54be1b409d8be5ebc8491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:16.358945 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-0dae400d-f2a1-488a-92a3-9b7189bda075 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] 10.222.0.20 "GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6" status: 200 len: 1755 microversion: 2.1 time: 0.322855 Jul 22 11:18:16.360452 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 255/512] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:16 2022] GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6 => generated 1755 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:18:16.571028 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-dedc8386-bb84-4394-af07-b535f2e120f2 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:16.573652 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-dedc8386-bb84-4394-af07-b535f2e120f2 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:16.591281 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dedc8386-bb84-4394-af07-b535f2e120f2 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:16.592371 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dedc8386-bb84-4394-af07-b535f2e120f2 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:16.593706 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dedc8386-bb84-4394-af07-b535f2e120f2 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:16.594495 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dedc8386-bb84-4394-af07-b535f2e120f2 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:16.792071 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-dedc8386-bb84-4394-af07-b535f2e120f2 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:16.803620 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-dedc8386-bb84-4394-af07-b535f2e120f2 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:16.805687 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-dedc8386-bb84-4394-af07-b535f2e120f2 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:16.807622 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-dedc8386-bb84-4394-af07-b535f2e120f2 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54" status: 200 len: 1740 microversion: 2.20 time: 0.244492 Jul 22 11:18:16.808522 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 258/513] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:18:16 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 => generated 1740 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:18:17.172423 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-5b1f7a7b-609c-44d5-9e95-826c9e4f26ea tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-91206518", "imageRef": "1a6c3cb4-9f56-44c6-aa68-01000df27209", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "32cd3386-64da-4740-85d1-ffc0b29096eb"}], "security_groups": [{"name": "tempest-securitygroup--1646259770"}], "key_name": "tempest-keypair-1673128683", "user_data": "}} {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:18:17.181226 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG dbcounter [-] [117884] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=117884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:18:17.327621 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.network.neutron [None req-5b1f7a7b-609c-44d5-9e95-826c9e4f26ea tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] validate_networks() for [('32cd3386-64da-4740-85d1-ffc0b29096eb', None, None, None, None, None)] {{(pid=117884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 22 11:18:17.380552 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-4e1393c5-fb54-4a4f-afc0-0790dd0e6ef5 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:17.381534 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-4e1393c5-fb54-4a4f-afc0-0790dd0e6ef5 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] [instance: 39fe8666-e4cc-464c-9af9-bd43835bccf6] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:17.389234 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4e1393c5-fb54-4a4f-afc0-0790dd0e6ef5 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:17.389951 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4e1393c5-fb54-4a4f-afc0-0790dd0e6ef5 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:17.390894 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4e1393c5-fb54-4a4f-afc0-0790dd0e6ef5 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:17.391523 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4e1393c5-fb54-4a4f-afc0-0790dd0e6ef5 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:17.663912 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-4e1393c5-fb54-4a4f-afc0-0790dd0e6ef5 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e908d2b09dfc4a139d9c27f52580e15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84fa2f397c54be1b409d8be5ebc8491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:17.691985 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-4e1393c5-fb54-4a4f-afc0-0790dd0e6ef5 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] 10.222.0.20 "GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6" status: 200 len: 1755 microversion: 2.1 time: 0.317175 Jul 22 11:18:17.700655 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 259/514] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:17 2022] GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6 => generated 1755 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:18:17.829440 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-1e836377-eac4-4ee4-b26c-af00306c87fb tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:17.830477 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-1e836377-eac4-4ee4-b26c-af00306c87fb tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:17.838483 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1e836377-eac4-4ee4-b26c-af00306c87fb tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:17.838937 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1e836377-eac4-4ee4-b26c-af00306c87fb tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:17.840441 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1e836377-eac4-4ee4-b26c-af00306c87fb tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:17.840441 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1e836377-eac4-4ee4-b26c-af00306c87fb tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:18.019643 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-1e836377-eac4-4ee4-b26c-af00306c87fb tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:18.019945 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.virt.hardware [None req-5b1f7a7b-609c-44d5-9e95-826c9e4f26ea tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Flavor limits 0:0:0 {{(pid=117884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 22 11:18:18.020444 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.virt.hardware [None req-5b1f7a7b-609c-44d5-9e95-826c9e4f26ea tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Image limits 0:0:0 {{(pid=117884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 22 11:18:18.020887 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.virt.hardware [None req-5b1f7a7b-609c-44d5-9e95-826c9e4f26ea tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Flavor pref 0:0:0 {{(pid=117884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 22 11:18:18.021447 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.virt.hardware [None req-5b1f7a7b-609c-44d5-9e95-826c9e4f26ea tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Image pref 0:0:0 {{(pid=117884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 22 11:18:18.022165 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.virt.hardware [None req-5b1f7a7b-609c-44d5-9e95-826c9e4f26ea tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 22 11:18:18.034120 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-1e836377-eac4-4ee4-b26c-af00306c87fb tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:18.034653 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-1e836377-eac4-4ee4-b26c-af00306c87fb tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:18.039077 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-1e836377-eac4-4ee4-b26c-af00306c87fb tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54" status: 200 len: 1740 microversion: 2.20 time: 0.212483 Jul 22 11:18:18.054561 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-5b1f7a7b-609c-44d5-9e95-826c9e4f26ea tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:18.054561 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-5b1f7a7b-609c-44d5-9e95-826c9e4f26ea tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:18.054561 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-5b1f7a7b-609c-44d5-9e95-826c9e4f26ea tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:18.054561 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-5b1f7a7b-609c-44d5-9e95-826c9e4f26ea tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:18.054969 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 260/515] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:18:17 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 => generated 1740 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 22 11:18:18.062418 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.quota [None req-5b1f7a7b-609c-44d5-9e95-826c9e4f26ea tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Getting quotas for project 28836b7cb9c646aaaa1bb1c1fae68128. Resources: {'instances', 'cores', 'ram'} {{(pid=117884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 22 11:18:18.066958 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.quota [None req-5b1f7a7b-609c-44d5-9e95-826c9e4f26ea tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Getting quotas for user 691877dce1024aeda61629073d74602b and project 28836b7cb9c646aaaa1bb1c1fae68128. Resources: {'instances', 'cores', 'ram'} {{(pid=117884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 22 11:18:18.080685 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-5b1f7a7b-609c-44d5-9e95-826c9e4f26ea tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Going to run 1 instances... {{(pid=117884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 22 11:18:18.082904 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-5b1f7a7b-609c-44d5-9e95-826c9e4f26ea tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 272976bd-b870-41a6-9bcd-598e1c9d34bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1a6c3cb4-9f56-44c6-aa68-01000df27209',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 22 11:18:18.145206 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-5b1f7a7b-609c-44d5-9e95-826c9e4f26ea tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.977531 Jul 22 11:18:18.151429 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 256/516] 10.222.0.20 () {60 vars in 1146 bytes} [Fri Jul 22 11:18:17 2022] POST /compute/v2.1/servers => generated 402 bytes in 986 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 22 11:18:18.156539 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-2560e748-9ab0-469e-b068-2a1414d6c04b tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:18.157684 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-2560e748-9ab0-469e-b068-2a1414d6c04b tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 272976bd-b870-41a6-9bcd-598e1c9d34bc] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:18.223289 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-2560e748-9ab0-469e-b068-2a1414d6c04b tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:18.230775 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-2560e748-9ab0-469e-b068-2a1414d6c04b tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/272976bd-b870-41a6-9bcd-598e1c9d34bc" status: 200 len: 1240 microversion: 2.1 time: 0.077873 Jul 22 11:18:18.231374 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 261/517] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:18 2022] GET /compute/v2.1/servers/272976bd-b870-41a6-9bcd-598e1c9d34bc => generated 1240 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:18:18.717881 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-64b18259-7ca4-4de9-ada9-c4fdec439053 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:18.719420 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-64b18259-7ca4-4de9-ada9-c4fdec439053 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] [instance: 39fe8666-e4cc-464c-9af9-bd43835bccf6] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:18.719997 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-2d1ebb4e-60b2-42c2-bc74-de13578db8e0 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:18.720540 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-2d1ebb4e-60b2-42c2-bc74-de13578db8e0 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:18.730503 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-64b18259-7ca4-4de9-ada9-c4fdec439053 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:18.731134 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-64b18259-7ca4-4de9-ada9-c4fdec439053 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:18.732028 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-64b18259-7ca4-4de9-ada9-c4fdec439053 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:18.732834 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-64b18259-7ca4-4de9-ada9-c4fdec439053 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:18.745822 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-2d1ebb4e-60b2-42c2-bc74-de13578db8e0 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:18.747690 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-2d1ebb4e-60b2-42c2-bc74-de13578db8e0 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:18.749131 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-2d1ebb4e-60b2-42c2-bc74-de13578db8e0 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:18.749900 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-2d1ebb4e-60b2-42c2-bc74-de13578db8e0 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:18.770705 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=100 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:18:18.926437 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-64b18259-7ca4-4de9-ada9-c4fdec439053 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e908d2b09dfc4a139d9c27f52580e15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84fa2f397c54be1b409d8be5ebc8491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:18.932990 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.objects.instance [None req-2d1ebb4e-60b2-42c2-bc74-de13578db8e0 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lazy-loading 'services' on Instance uuid 1cafe061-7a16-4c2c-8796-da7dac3f27f1 {{(pid=117884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 22 11:18:18.938919 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-64b18259-7ca4-4de9-ada9-c4fdec439053 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] 10.222.0.20 "GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6" status: 200 len: 1755 microversion: 2.1 time: 0.223680 Jul 22 11:18:18.938919 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 262/518] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:18 2022] GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6 => generated 1755 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:18:19.031710 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-2d1ebb4e-60b2-42c2-bc74-de13578db8e0 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1/os-volume_attachments/8b678413-f41d-4be8-a739-5359ce8a8f16" status: 202 len: 0 microversion: 2.1 time: 0.317783 Jul 22 11:18:19.032335 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 257/519] 10.222.0.20 () {58 vars in 1415 bytes} [Fri Jul 22 11:18:18 2022] DELETE /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1/os-volume_attachments/8b678413-f41d-4be8-a739-5359ce8a8f16 => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 22 11:18:19.061674 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-b38f05a0-0adc-48a4-bb80-652894b7aeb6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:19.062691 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-b38f05a0-0adc-48a4-bb80-652894b7aeb6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:19.072556 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b38f05a0-0adc-48a4-bb80-652894b7aeb6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:19.073256 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b38f05a0-0adc-48a4-bb80-652894b7aeb6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:19.074670 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b38f05a0-0adc-48a4-bb80-652894b7aeb6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:19.075424 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b38f05a0-0adc-48a4-bb80-652894b7aeb6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:19.249952 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-b38f05a0-0adc-48a4-bb80-652894b7aeb6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:19.258869 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-bb60839c-e482-4763-b652-9feabbb0f4cc tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:19.262039 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-bb60839c-e482-4763-b652-9feabbb0f4cc tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 272976bd-b870-41a6-9bcd-598e1c9d34bc] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:19.263528 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-b38f05a0-0adc-48a4-bb80-652894b7aeb6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:19.267330 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-b38f05a0-0adc-48a4-bb80-652894b7aeb6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:19.269640 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-b38f05a0-0adc-48a4-bb80-652894b7aeb6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54" status: 200 len: 1740 microversion: 2.20 time: 0.215512 Jul 22 11:18:19.283289 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-bb60839c-e482-4763-b652-9feabbb0f4cc tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:19.283967 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 263/520] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:18:19 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 => generated 1740 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:18:19.286145 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-bb60839c-e482-4763-b652-9feabbb0f4cc tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:19.287141 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-bb60839c-e482-4763-b652-9feabbb0f4cc tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:19.287658 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-bb60839c-e482-4763-b652-9feabbb0f4cc tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:19.362319 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-bb60839c-e482-4763-b652-9feabbb0f4cc tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:19.371630 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-bb60839c-e482-4763-b652-9feabbb0f4cc tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/272976bd-b870-41a6-9bcd-598e1c9d34bc" status: 200 len: 1244 microversion: 2.1 time: 0.123599 Jul 22 11:18:19.381365 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 258/521] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:19 2022] GET /compute/v2.1/servers/272976bd-b870-41a6-9bcd-598e1c9d34bc => generated 1244 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:18:19.785133 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-924a2b5b-9641-4360-bc87-768b39f1588c tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:18:19.786166 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-924a2b5b-9641-4360-bc87-768b39f1588c tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 6d50352a-fd4f-4ca5-8e13-2519dfbb66a1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:19.793021 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-924a2b5b-9641-4360-bc87-768b39f1588c tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:19.793461 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-924a2b5b-9641-4360-bc87-768b39f1588c tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:19.794234 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-924a2b5b-9641-4360-bc87-768b39f1588c tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:19.794675 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-924a2b5b-9641-4360-bc87-768b39f1588c tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:19.820542 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.objects.instance [None req-924a2b5b-9641-4360-bc87-768b39f1588c tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lazy-loading 'flavor' on Instance uuid 6d50352a-fd4f-4ca5-8e13-2519dfbb66a1 {{(pid=117885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 22 11:18:19.961433 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-aab42ac9-90ab-43ff-93ba-4845d42b6197 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:19.962450 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-aab42ac9-90ab-43ff-93ba-4845d42b6197 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] [instance: 39fe8666-e4cc-464c-9af9-bd43835bccf6] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:19.972153 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-924a2b5b-9641-4360-bc87-768b39f1588c tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "POST /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1/action" status: 200 len: 32 microversion: 2.1 time: 0.191313 Jul 22 11:18:19.972826 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 264/522] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Jul 22 11:18:19 2022] POST /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1/action => generated 32 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 22 11:18:19.976034 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-aab42ac9-90ab-43ff-93ba-4845d42b6197 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:19.976034 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-aab42ac9-90ab-43ff-93ba-4845d42b6197 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:19.976034 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-aab42ac9-90ab-43ff-93ba-4845d42b6197 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:19.976467 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-aab42ac9-90ab-43ff-93ba-4845d42b6197 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:19.983731 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-8d37d151-ed3b-4780-a597-efb7b05a3749 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:19.984435 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-8d37d151-ed3b-4780-a597-efb7b05a3749 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 6d50352a-fd4f-4ca5-8e13-2519dfbb66a1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:19.991162 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8d37d151-ed3b-4780-a597-efb7b05a3749 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:19.991654 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8d37d151-ed3b-4780-a597-efb7b05a3749 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:19.992478 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8d37d151-ed3b-4780-a597-efb7b05a3749 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:19.992868 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8d37d151-ed3b-4780-a597-efb7b05a3749 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:20.162190 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-8d37d151-ed3b-4780-a597-efb7b05a3749 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:20.171495 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-8d37d151-ed3b-4780-a597-efb7b05a3749 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1" status: 200 len: 1735 microversion: 2.1 time: 0.192603 Jul 22 11:18:20.172652 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 265/523] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:19 2022] GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1 => generated 1735 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:18:20.196714 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-aab42ac9-90ab-43ff-93ba-4845d42b6197 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e908d2b09dfc4a139d9c27f52580e15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84fa2f397c54be1b409d8be5ebc8491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:20.213204 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-aab42ac9-90ab-43ff-93ba-4845d42b6197 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] 10.222.0.20 "GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6" status: 200 len: 1755 microversion: 2.1 time: 0.258648 Jul 22 11:18:20.214342 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 259/524] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:19 2022] GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6 => generated 1755 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:18:20.294546 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-0b7130a2-4e23-42aa-a490-64dc574af2b6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:20.295154 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-0b7130a2-4e23-42aa-a490-64dc574af2b6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:20.301415 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0b7130a2-4e23-42aa-a490-64dc574af2b6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:20.301849 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0b7130a2-4e23-42aa-a490-64dc574af2b6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:20.302615 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0b7130a2-4e23-42aa-a490-64dc574af2b6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:20.303042 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0b7130a2-4e23-42aa-a490-64dc574af2b6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:20.394831 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-61885a17-b6e3-4a11-9949-f7638fd98689 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:20.395482 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-61885a17-b6e3-4a11-9949-f7638fd98689 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 272976bd-b870-41a6-9bcd-598e1c9d34bc] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:20.408467 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-61885a17-b6e3-4a11-9949-f7638fd98689 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:20.409067 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-61885a17-b6e3-4a11-9949-f7638fd98689 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:20.413131 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-61885a17-b6e3-4a11-9949-f7638fd98689 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:20.413647 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-61885a17-b6e3-4a11-9949-f7638fd98689 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:20.484213 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-61885a17-b6e3-4a11-9949-f7638fd98689 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:20.494252 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-61885a17-b6e3-4a11-9949-f7638fd98689 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/272976bd-b870-41a6-9bcd-598e1c9d34bc" status: 200 len: 1292 microversion: 2.1 time: 0.105556 Jul 22 11:18:20.495157 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 260/525] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:20 2022] GET /compute/v2.1/servers/272976bd-b870-41a6-9bcd-598e1c9d34bc => generated 1292 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:18:20.514078 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-0b7130a2-4e23-42aa-a490-64dc574af2b6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:20.524331 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-0b7130a2-4e23-42aa-a490-64dc574af2b6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:20.526383 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-0b7130a2-4e23-42aa-a490-64dc574af2b6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:20.527689 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-0b7130a2-4e23-42aa-a490-64dc574af2b6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54" status: 200 len: 1722 microversion: 2.20 time: 0.238392 Jul 22 11:18:20.528175 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 266/526] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:18:20 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 => generated 1722 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:18:21.196116 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-f4ca9821-81af-4fa4-b814-f2912c570b4d tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:21.198714 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-f4ca9821-81af-4fa4-b814-f2912c570b4d tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 6d50352a-fd4f-4ca5-8e13-2519dfbb66a1] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:21.213478 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f4ca9821-81af-4fa4-b814-f2912c570b4d tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:21.215423 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f4ca9821-81af-4fa4-b814-f2912c570b4d tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:21.217239 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f4ca9821-81af-4fa4-b814-f2912c570b4d tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:21.221391 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f4ca9821-81af-4fa4-b814-f2912c570b4d tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:21.232822 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-bb6ec981-8b92-4eea-8e13-0def3a36325e tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:21.233701 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-bb6ec981-8b92-4eea-8e13-0def3a36325e tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] [instance: 39fe8666-e4cc-464c-9af9-bd43835bccf6] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:21.243546 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-bb6ec981-8b92-4eea-8e13-0def3a36325e tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:21.244140 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-bb6ec981-8b92-4eea-8e13-0def3a36325e tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:21.244808 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-bb6ec981-8b92-4eea-8e13-0def3a36325e tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:21.245252 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-bb6ec981-8b92-4eea-8e13-0def3a36325e tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:21.539378 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-bb6ec981-8b92-4eea-8e13-0def3a36325e tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e908d2b09dfc4a139d9c27f52580e15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84fa2f397c54be1b409d8be5ebc8491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:21.566183 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-bb6ec981-8b92-4eea-8e13-0def3a36325e tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] 10.222.0.20 "GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6" status: 200 len: 1758 microversion: 2.1 time: 0.333420 Jul 22 11:18:21.572891 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 267/527] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:21 2022] GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6 => generated 1758 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:18:21.583039 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-89f16222-7683-4f99-8a35-98feb3306c7b tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:21.583810 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-89f16222-7683-4f99-8a35-98feb3306c7b tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 272976bd-b870-41a6-9bcd-598e1c9d34bc] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:21.591987 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-89f16222-7683-4f99-8a35-98feb3306c7b tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:21.593065 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-89f16222-7683-4f99-8a35-98feb3306c7b tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:21.593940 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-89f16222-7683-4f99-8a35-98feb3306c7b tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:21.594459 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-89f16222-7683-4f99-8a35-98feb3306c7b tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:21.690894 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-f4ca9821-81af-4fa4-b814-f2912c570b4d tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:21.700090 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-f4ca9821-81af-4fa4-b814-f2912c570b4d tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1" status: 200 len: 1735 microversion: 2.1 time: 0.510631 Jul 22 11:18:21.701045 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 261/528] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:21 2022] GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1 => generated 1735 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:18:21.706037 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-45e1c503-0a9f-4157-92f9-21c589d37b5f tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:21.706845 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-45e1c503-0a9f-4157-92f9-21c589d37b5f tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:21.712867 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-89f16222-7683-4f99-8a35-98feb3306c7b tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:21.720539 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-45e1c503-0a9f-4157-92f9-21c589d37b5f tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:21.721062 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-45e1c503-0a9f-4157-92f9-21c589d37b5f tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:21.721880 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-45e1c503-0a9f-4157-92f9-21c589d37b5f tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:21.722425 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-45e1c503-0a9f-4157-92f9-21c589d37b5f tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:21.726610 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-89f16222-7683-4f99-8a35-98feb3306c7b tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/272976bd-b870-41a6-9bcd-598e1c9d34bc" status: 200 len: 1298 microversion: 2.1 time: 0.152488 Jul 22 11:18:21.728156 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 268/529] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:21 2022] GET /compute/v2.1/servers/272976bd-b870-41a6-9bcd-598e1c9d34bc => generated 1298 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:18:22.062336 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-45e1c503-0a9f-4157-92f9-21c589d37b5f tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:22.071723 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-45e1c503-0a9f-4157-92f9-21c589d37b5f tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:22.073382 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-45e1c503-0a9f-4157-92f9-21c589d37b5f tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:22.074570 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-45e1c503-0a9f-4157-92f9-21c589d37b5f tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54" status: 200 len: 1722 microversion: 2.20 time: 0.372417 Jul 22 11:18:22.075142 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 262/530] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:18:21 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 => generated 1722 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:18:22.371594 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-ba5944ef-71f6-440e-b978-a03c90f13264 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:18:22.378285 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ba5944ef-71f6-440e-b978-a03c90f13264 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:22.378724 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ba5944ef-71f6-440e-b978-a03c90f13264 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:22.445894 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-ba5944ef-71f6-440e-b978-a03c90f13264 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Going to try to stop instance {{(pid=117885) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 22 11:18:22.497334 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-ba5944ef-71f6-440e-b978-a03c90f13264 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "POST /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1/action" status: 202 len: 0 microversion: 2.1 time: 0.129559 Jul 22 11:18:22.497953 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 269/531] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Jul 22 11:18:22 2022] POST /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 22 11:18:22.506159 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-a9e56b31-7861-40d4-931b-f058e185eb4d tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:22.507444 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-a9e56b31-7861-40d4-931b-f058e185eb4d tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:22.515189 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-a9e56b31-7861-40d4-931b-f058e185eb4d tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:22.515676 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-a9e56b31-7861-40d4-931b-f058e185eb4d tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:22.516537 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-a9e56b31-7861-40d4-931b-f058e185eb4d tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:22.516897 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-a9e56b31-7861-40d4-931b-f058e185eb4d tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:22.688511 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-a9e56b31-7861-40d4-931b-f058e185eb4d tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:22.698978 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-a9e56b31-7861-40d4-931b-f058e185eb4d tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1675 microversion: 2.1 time: 0.196674 Jul 22 11:18:22.699609 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 263/532] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:22 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1675 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:18:22.718223 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-cb41bc6d-4dfe-4862-9833-7e1c7a1e4e40 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:22.719026 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-cb41bc6d-4dfe-4862-9833-7e1c7a1e4e40 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 6d50352a-fd4f-4ca5-8e13-2519dfbb66a1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:22.725401 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-cb41bc6d-4dfe-4862-9833-7e1c7a1e4e40 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:22.725825 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-cb41bc6d-4dfe-4862-9833-7e1c7a1e4e40 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:22.726595 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-cb41bc6d-4dfe-4862-9833-7e1c7a1e4e40 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:22.727016 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-cb41bc6d-4dfe-4862-9833-7e1c7a1e4e40 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:22.747936 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-6cbfbdf5-fc91-4429-ae83-90d4decd4b9f tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:22.748549 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-6cbfbdf5-fc91-4429-ae83-90d4decd4b9f tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 272976bd-b870-41a6-9bcd-598e1c9d34bc] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:22.754743 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-6cbfbdf5-fc91-4429-ae83-90d4decd4b9f tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:22.755309 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-6cbfbdf5-fc91-4429-ae83-90d4decd4b9f tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:22.756173 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-6cbfbdf5-fc91-4429-ae83-90d4decd4b9f tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:22.756633 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-6cbfbdf5-fc91-4429-ae83-90d4decd4b9f tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:22.872695 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-cb41bc6d-4dfe-4862-9833-7e1c7a1e4e40 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:22.880977 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-cb41bc6d-4dfe-4862-9833-7e1c7a1e4e40 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1" status: 200 len: 1735 microversion: 2.1 time: 0.166878 Jul 22 11:18:22.881555 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 270/533] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:22 2022] GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:18:22.905341 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-6cbfbdf5-fc91-4429-ae83-90d4decd4b9f tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:22.913071 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-6cbfbdf5-fc91-4429-ae83-90d4decd4b9f tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/272976bd-b870-41a6-9bcd-598e1c9d34bc" status: 200 len: 1366 microversion: 2.1 time: 0.170596 Jul 22 11:18:22.913693 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 264/534] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:22 2022] GET /compute/v2.1/servers/272976bd-b870-41a6-9bcd-598e1c9d34bc => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:18:23.092595 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-a2f2fcf5-ea62-4b95-ab8d-b6142e27c018 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:23.093238 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-a2f2fcf5-ea62-4b95-ab8d-b6142e27c018 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:23.100291 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a2f2fcf5-ea62-4b95-ab8d-b6142e27c018 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:23.100291 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a2f2fcf5-ea62-4b95-ab8d-b6142e27c018 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:23.100996 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a2f2fcf5-ea62-4b95-ab8d-b6142e27c018 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:23.101439 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a2f2fcf5-ea62-4b95-ab8d-b6142e27c018 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:23.108786 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [req-73b50c03-56d2-4bf2-b0d1-17ae5c2b8b41 req-41f7c537-403d-4254-9850-19c13930315e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f27dab8-c005-4dd0-b262-542deb60dd54", "name": "network-vif-unplugged", "status": "completed", "tag": "019d06a1-2c6e-4ebb-b1f0-a080fc8a2fef"}]} {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:18:23.119507 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-73b50c03-56d2-4bf2-b0d1-17ae5c2b8b41 req-41f7c537-403d-4254-9850-19c13930315e service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:23.119952 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-73b50c03-56d2-4bf2-b0d1-17ae5c2b8b41 req-41f7c537-403d-4254-9850-19c13930315e service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:23.134648 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.compute.server_external_events [req-73b50c03-56d2-4bf2-b0d1-17ae5c2b8b41 req-41f7c537-403d-4254-9850-19c13930315e service nova] Creating event network-vif-unplugged:019d06a1-2c6e-4ebb-b1f0-a080fc8a2fef for instance 1f27dab8-c005-4dd0-b262-542deb60dd54 on hv-cinder-84890 Jul 22 11:18:23.139860 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [req-73b50c03-56d2-4bf2-b0d1-17ae5c2b8b41 req-41f7c537-403d-4254-9850-19c13930315e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034616 Jul 22 11:18:23.150995 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 265/535] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:18:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 22 11:18:23.245813 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-a2f2fcf5-ea62-4b95-ab8d-b6142e27c018 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:23.254073 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-a2f2fcf5-ea62-4b95-ab8d-b6142e27c018 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:23.255610 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-a2f2fcf5-ea62-4b95-ab8d-b6142e27c018 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:23.257183 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-a2f2fcf5-ea62-4b95-ab8d-b6142e27c018 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54" status: 200 len: 1722 microversion: 2.20 time: 0.168402 Jul 22 11:18:23.257359 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 271/536] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:18:23 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:18:23.723427 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-ee15b92a-2e81-4599-b0cf-027c2a9e57a5 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:23.724417 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-ee15b92a-2e81-4599-b0cf-027c2a9e57a5 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:23.733869 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-ee15b92a-2e81-4599-b0cf-027c2a9e57a5 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:23.734481 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-ee15b92a-2e81-4599-b0cf-027c2a9e57a5 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:23.736090 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-ee15b92a-2e81-4599-b0cf-027c2a9e57a5 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:23.736090 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-ee15b92a-2e81-4599-b0cf-027c2a9e57a5 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:23.902181 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-e21a172b-aac0-42ac-a1b9-62d410267564 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:23.902916 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-e21a172b-aac0-42ac-a1b9-62d410267564 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 6d50352a-fd4f-4ca5-8e13-2519dfbb66a1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:23.910051 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e21a172b-aac0-42ac-a1b9-62d410267564 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:23.910490 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e21a172b-aac0-42ac-a1b9-62d410267564 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:23.911290 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e21a172b-aac0-42ac-a1b9-62d410267564 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:23.911711 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e21a172b-aac0-42ac-a1b9-62d410267564 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:23.965058 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-ee15b92a-2e81-4599-b0cf-027c2a9e57a5 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:23.973316 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-ee15b92a-2e81-4599-b0cf-027c2a9e57a5 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1675 microversion: 2.1 time: 0.257698 Jul 22 11:18:23.974049 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 266/537] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:23 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1675 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:18:23.984819 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-7123ac2d-4015-4de5-b732-f27b1346d204 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:23.985730 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-7123ac2d-4015-4de5-b732-f27b1346d204 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 272976bd-b870-41a6-9bcd-598e1c9d34bc] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:23.993558 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-7123ac2d-4015-4de5-b732-f27b1346d204 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:23.994002 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-7123ac2d-4015-4de5-b732-f27b1346d204 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:23.994783 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-7123ac2d-4015-4de5-b732-f27b1346d204 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:23.995440 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-7123ac2d-4015-4de5-b732-f27b1346d204 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:24.021479 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG dbcounter [-] [117884] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:18:24.094527 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-e21a172b-aac0-42ac-a1b9-62d410267564 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:24.109571 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-e21a172b-aac0-42ac-a1b9-62d410267564 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1" status: 200 len: 1735 microversion: 2.1 time: 0.212399 Jul 22 11:18:24.110405 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 272/538] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:23 2022] GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1 => generated 1735 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:18:24.255224 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-7123ac2d-4015-4de5-b732-f27b1346d204 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:24.264236 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-7123ac2d-4015-4de5-b732-f27b1346d204 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/272976bd-b870-41a6-9bcd-598e1c9d34bc" status: 200 len: 1366 microversion: 2.1 time: 0.288870 Jul 22 11:18:24.265205 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 267/539] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:23 2022] GET /compute/v2.1/servers/272976bd-b870-41a6-9bcd-598e1c9d34bc => generated 1366 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:18:24.284306 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-725d3274-3764-4f42-88e8-9b8285cba539 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:24.286255 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-725d3274-3764-4f42-88e8-9b8285cba539 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:24.293232 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-725d3274-3764-4f42-88e8-9b8285cba539 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:24.294406 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-725d3274-3764-4f42-88e8-9b8285cba539 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:24.295330 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-725d3274-3764-4f42-88e8-9b8285cba539 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:24.295873 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-725d3274-3764-4f42-88e8-9b8285cba539 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:24.475826 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-725d3274-3764-4f42-88e8-9b8285cba539 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:24.492118 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-725d3274-3764-4f42-88e8-9b8285cba539 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:24.496128 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-725d3274-3764-4f42-88e8-9b8285cba539 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:24.498385 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-725d3274-3764-4f42-88e8-9b8285cba539 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54" status: 200 len: 1725 microversion: 2.20 time: 0.227023 Jul 22 11:18:24.512122 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 273/540] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:18:24 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 => generated 1725 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:18:24.532430 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-928b96bc-59aa-42ed-a3d2-05c68d4d47cd tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6c55d6d2-3a80-4306-b682-9b6e06b203e2"}} {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:18:24.533592 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-928b96bc-59aa-42ed-a3d2-05c68d4d47cd tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:24.543285 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-8a4518e9-2dba-4e73-a12a-5cb2eb0de12d req-50da0444-788d-4b8d-a653-2c573002c718 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "272976bd-b870-41a6-9bcd-598e1c9d34bc", "tag": "c4d22b99-709d-4d50-a237-82850eeff0a1"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:18:24.544684 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-928b96bc-59aa-42ed-a3d2-05c68d4d47cd tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:24.545469 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-928b96bc-59aa-42ed-a3d2-05c68d4d47cd tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:24.546533 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-928b96bc-59aa-42ed-a3d2-05c68d4d47cd tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:24.547086 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-928b96bc-59aa-42ed-a3d2-05c68d4d47cd tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:24.564498 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-8a4518e9-2dba-4e73-a12a-5cb2eb0de12d req-50da0444-788d-4b8d-a653-2c573002c718 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:24.565649 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-8a4518e9-2dba-4e73-a12a-5cb2eb0de12d req-50da0444-788d-4b8d-a653-2c573002c718 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:24.582684 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-8a4518e9-2dba-4e73-a12a-5cb2eb0de12d req-50da0444-788d-4b8d-a653-2c573002c718 service nova] Creating event network-changed:c4d22b99-709d-4d50-a237-82850eeff0a1 for instance 272976bd-b870-41a6-9bcd-598e1c9d34bc on hv-cinder-84890 Jul 22 11:18:24.588638 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-8a4518e9-2dba-4e73-a12a-5cb2eb0de12d req-50da0444-788d-4b8d-a653-2c573002c718 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052259 Jul 22 11:18:24.590443 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 274/541] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:18:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 22 11:18:24.949878 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-928b96bc-59aa-42ed-a3d2-05c68d4d47cd tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "POST /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.424238 Jul 22 11:18:24.950936 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 268/542] 10.222.0.20 () {62 vars in 1363 bytes} [Fri Jul 22 11:18:24 2022] POST /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54/os-volume_attachments => generated 188 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 22 11:18:24.996650 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-86973ed7-0f33-46be-8b98-131008739428 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:24.998083 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-86973ed7-0f33-46be-8b98-131008739428 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:25.004863 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-86973ed7-0f33-46be-8b98-131008739428 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:25.005471 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-86973ed7-0f33-46be-8b98-131008739428 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:25.006486 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-86973ed7-0f33-46be-8b98-131008739428 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:25.007121 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-86973ed7-0f33-46be-8b98-131008739428 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:25.090034 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-958b01b0-6a14-4d3a-ae72-6e5a9fcd8b49 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:18:25.090600 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-958b01b0-6a14-4d3a-ae72-6e5a9fcd8b49 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:25.097871 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-958b01b0-6a14-4d3a-ae72-6e5a9fcd8b49 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:25.098384 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-958b01b0-6a14-4d3a-ae72-6e5a9fcd8b49 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:25.099789 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-958b01b0-6a14-4d3a-ae72-6e5a9fcd8b49 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:25.100574 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-958b01b0-6a14-4d3a-ae72-6e5a9fcd8b49 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:25.189557 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-86973ed7-0f33-46be-8b98-131008739428 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:25.197442 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-86973ed7-0f33-46be-8b98-131008739428 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1675 microversion: 2.1 time: 0.208219 Jul 22 11:18:25.198742 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 275/543] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:24 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1675 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:18:25.203828 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-8facde8b-4995-4cb8-9d82-f638e19e6564 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:25.204707 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-8facde8b-4995-4cb8-9d82-f638e19e6564 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 6d50352a-fd4f-4ca5-8e13-2519dfbb66a1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:25.212984 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8facde8b-4995-4cb8-9d82-f638e19e6564 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:25.213654 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8facde8b-4995-4cb8-9d82-f638e19e6564 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:25.214948 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8facde8b-4995-4cb8-9d82-f638e19e6564 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:25.215411 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8facde8b-4995-4cb8-9d82-f638e19e6564 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:25.223929 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-958b01b0-6a14-4d3a-ae72-6e5a9fcd8b49 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "POST /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54/action" status: 202 len: 0 microversion: 2.20 time: 0.138484 Jul 22 11:18:25.224799 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 269/544] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Jul 22 11:18:25 2022] POST /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 22 11:18:25.236946 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-5b2d0237-0cbf-482f-9a8d-671fad3c5920 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:25.238133 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-5b2d0237-0cbf-482f-9a8d-671fad3c5920 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:25.249110 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-5b2d0237-0cbf-482f-9a8d-671fad3c5920 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:25.249889 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-5b2d0237-0cbf-482f-9a8d-671fad3c5920 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:25.251301 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-5b2d0237-0cbf-482f-9a8d-671fad3c5920 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:25.252098 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-5b2d0237-0cbf-482f-9a8d-671fad3c5920 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:25.378863 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-8facde8b-4995-4cb8-9d82-f638e19e6564 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:25.382609 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:18:25.389729 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-8facde8b-4995-4cb8-9d82-f638e19e6564 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1" status: 200 len: 1735 microversion: 2.1 time: 0.189620 Jul 22 11:18:25.391052 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 276/545] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:25 2022] GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1 => generated 1735 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:18:25.397240 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-9d317cef-ef04-4426-9e53-3ad2373fe802 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:25.398609 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-9d317cef-ef04-4426-9e53-3ad2373fe802 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 272976bd-b870-41a6-9bcd-598e1c9d34bc] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:25.421373 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9d317cef-ef04-4426-9e53-3ad2373fe802 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:25.422272 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9d317cef-ef04-4426-9e53-3ad2373fe802 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:25.423804 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9d317cef-ef04-4426-9e53-3ad2373fe802 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:25.424769 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9d317cef-ef04-4426-9e53-3ad2373fe802 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:25.466292 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-5b2d0237-0cbf-482f-9a8d-671fad3c5920 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:25.476363 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-5b2d0237-0cbf-482f-9a8d-671fad3c5920 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:25.477961 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-5b2d0237-0cbf-482f-9a8d-671fad3c5920 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:25.479125 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-5b2d0237-0cbf-482f-9a8d-671fad3c5920 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54" status: 200 len: 1751 microversion: 2.20 time: 0.248356 Jul 22 11:18:25.479726 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 270/546] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:18:25 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 => generated 1751 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 22 11:18:25.612606 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-9d317cef-ef04-4426-9e53-3ad2373fe802 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:25.622649 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-9d317cef-ef04-4426-9e53-3ad2373fe802 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/272976bd-b870-41a6-9bcd-598e1c9d34bc" status: 200 len: 1366 microversion: 2.1 time: 0.229643 Jul 22 11:18:25.623236 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 277/547] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:25 2022] GET /compute/v2.1/servers/272976bd-b870-41a6-9bcd-598e1c9d34bc => generated 1366 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:18:26.220535 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-3e3d82e4-521a-4f82-9115-93f90840f4f2 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:26.221338 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-3e3d82e4-521a-4f82-9115-93f90840f4f2 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:26.228161 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-3e3d82e4-521a-4f82-9115-93f90840f4f2 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:26.228728 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-3e3d82e4-521a-4f82-9115-93f90840f4f2 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:26.229848 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-3e3d82e4-521a-4f82-9115-93f90840f4f2 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:26.230288 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-3e3d82e4-521a-4f82-9115-93f90840f4f2 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:26.431829 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-7e49301e-3bd5-4d40-9438-c6cc19b6ae57 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:26.432833 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-7e49301e-3bd5-4d40-9438-c6cc19b6ae57 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 6d50352a-fd4f-4ca5-8e13-2519dfbb66a1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:26.443630 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7e49301e-3bd5-4d40-9438-c6cc19b6ae57 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:26.444098 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7e49301e-3bd5-4d40-9438-c6cc19b6ae57 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:26.444904 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7e49301e-3bd5-4d40-9438-c6cc19b6ae57 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:26.445346 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7e49301e-3bd5-4d40-9438-c6cc19b6ae57 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:26.525054 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-3e3d82e4-521a-4f82-9115-93f90840f4f2 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:26.535912 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-3e3d82e4-521a-4f82-9115-93f90840f4f2 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1675 microversion: 2.1 time: 0.319231 Jul 22 11:18:26.536668 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 271/548] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:26 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1675 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:18:26.545128 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-716d5e3d-0501-4be8-babc-2bea598c631d tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:26.547562 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-716d5e3d-0501-4be8-babc-2bea598c631d tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:26.560623 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-716d5e3d-0501-4be8-babc-2bea598c631d tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:26.561645 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-716d5e3d-0501-4be8-babc-2bea598c631d tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:26.563280 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-716d5e3d-0501-4be8-babc-2bea598c631d tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:26.564267 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-716d5e3d-0501-4be8-babc-2bea598c631d tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:26.634819 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-7e49301e-3bd5-4d40-9438-c6cc19b6ae57 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:26.649788 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-7e49301e-3bd5-4d40-9438-c6cc19b6ae57 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1" status: 200 len: 1735 microversion: 2.1 time: 0.232363 Jul 22 11:18:26.655861 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 278/549] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:26 2022] GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1 => generated 1735 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:18:26.659308 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-1c8a7d65-436e-4a28-a7db-7577235aa923 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:26.660227 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-1c8a7d65-436e-4a28-a7db-7577235aa923 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 272976bd-b870-41a6-9bcd-598e1c9d34bc] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:26.667864 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1c8a7d65-436e-4a28-a7db-7577235aa923 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:26.668319 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1c8a7d65-436e-4a28-a7db-7577235aa923 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:26.669106 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1c8a7d65-436e-4a28-a7db-7577235aa923 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:26.669538 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1c8a7d65-436e-4a28-a7db-7577235aa923 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:26.864201 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-1c8a7d65-436e-4a28-a7db-7577235aa923 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:26.873265 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-1c8a7d65-436e-4a28-a7db-7577235aa923 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/272976bd-b870-41a6-9bcd-598e1c9d34bc" status: 200 len: 1366 microversion: 2.1 time: 0.220454 Jul 22 11:18:26.873869 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 279/550] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:26 2022] GET /compute/v2.1/servers/272976bd-b870-41a6-9bcd-598e1c9d34bc => generated 1366 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:18:27.074649 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-716d5e3d-0501-4be8-babc-2bea598c631d tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:27.087569 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-716d5e3d-0501-4be8-babc-2bea598c631d tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:27.089403 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-716d5e3d-0501-4be8-babc-2bea598c631d tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:27.090582 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-716d5e3d-0501-4be8-babc-2bea598c631d tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54" status: 200 len: 1753 microversion: 2.20 time: 0.552494 Jul 22 11:18:27.091482 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 272/551] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:18:26 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 => generated 1753 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:18:27.558559 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-9683b2fd-ad7d-4536-ab3e-6b9429a2eb2a tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:27.560328 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-9683b2fd-ad7d-4536-ab3e-6b9429a2eb2a tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:27.570481 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9683b2fd-ad7d-4536-ab3e-6b9429a2eb2a tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:27.571277 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9683b2fd-ad7d-4536-ab3e-6b9429a2eb2a tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:27.572697 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9683b2fd-ad7d-4536-ab3e-6b9429a2eb2a tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:27.573627 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9683b2fd-ad7d-4536-ab3e-6b9429a2eb2a tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:27.673150 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-73cf2e8a-1563-4ca2-b0f7-9bb475c1f37e tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:27.674110 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-73cf2e8a-1563-4ca2-b0f7-9bb475c1f37e tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 6d50352a-fd4f-4ca5-8e13-2519dfbb66a1] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:27.681555 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-73cf2e8a-1563-4ca2-b0f7-9bb475c1f37e tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:27.682092 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-73cf2e8a-1563-4ca2-b0f7-9bb475c1f37e tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:27.682954 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-73cf2e8a-1563-4ca2-b0f7-9bb475c1f37e tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:27.683615 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-73cf2e8a-1563-4ca2-b0f7-9bb475c1f37e tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:27.828061 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-9683b2fd-ad7d-4536-ab3e-6b9429a2eb2a tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:27.841425 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-73cf2e8a-1563-4ca2-b0f7-9bb475c1f37e tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:27.844547 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-9683b2fd-ad7d-4536-ab3e-6b9429a2eb2a tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1675 microversion: 2.1 time: 0.291782 Jul 22 11:18:27.850015 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-73cf2e8a-1563-4ca2-b0f7-9bb475c1f37e tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1" status: 200 len: 1735 microversion: 2.1 time: 0.180783 Jul 22 11:18:27.857810 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 280/552] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:27 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1675 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:18:27.859243 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 273/553] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:27 2022] GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1 => generated 1735 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:18:27.893010 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-7e77c97a-b8db-4b42-90f7-8275317b847c tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:27.893620 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-7e77c97a-b8db-4b42-90f7-8275317b847c tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 272976bd-b870-41a6-9bcd-598e1c9d34bc] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:27.902724 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7e77c97a-b8db-4b42-90f7-8275317b847c tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:27.903510 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7e77c97a-b8db-4b42-90f7-8275317b847c tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:27.904856 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7e77c97a-b8db-4b42-90f7-8275317b847c tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:27.905450 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7e77c97a-b8db-4b42-90f7-8275317b847c tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:28.085934 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-7e77c97a-b8db-4b42-90f7-8275317b847c tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:28.094105 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-7e77c97a-b8db-4b42-90f7-8275317b847c tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/272976bd-b870-41a6-9bcd-598e1c9d34bc" status: 200 len: 1366 microversion: 2.1 time: 0.205029 Jul 22 11:18:28.094690 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 281/554] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:27 2022] GET /compute/v2.1/servers/272976bd-b870-41a6-9bcd-598e1c9d34bc => generated 1366 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:18:28.126112 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-3bd2071e-f1ef-470a-976e-8889e541abe7 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:28.127223 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-3bd2071e-f1ef-470a-976e-8889e541abe7 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:28.130095 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG dbcounter [-] [117884] Writing DB stats nova_cell0:SELECT=2 {{(pid=117884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:18:28.130998 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG dbcounter [-] [117884] Writing DB stats nova_cell0:SELECT=10 {{(pid=117884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:18:28.141991 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-3bd2071e-f1ef-470a-976e-8889e541abe7 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:28.142793 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-3bd2071e-f1ef-470a-976e-8889e541abe7 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:28.144210 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-3bd2071e-f1ef-470a-976e-8889e541abe7 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:28.144993 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-3bd2071e-f1ef-470a-976e-8889e541abe7 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:28.351760 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-3bd2071e-f1ef-470a-976e-8889e541abe7 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:28.367187 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-3bd2071e-f1ef-470a-976e-8889e541abe7 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:28.370426 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-3bd2071e-f1ef-470a-976e-8889e541abe7 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:28.372378 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-3bd2071e-f1ef-470a-976e-8889e541abe7 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54" status: 200 len: 1809 microversion: 2.20 time: 0.253080 Jul 22 11:18:28.373210 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 274/555] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:18:28 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 => generated 1809 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:18:28.869991 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-2e5807df-e21e-40ac-a9e3-94e5a292fe53 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:28.871048 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-2e5807df-e21e-40ac-a9e3-94e5a292fe53 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:28.874275 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell0:SELECT=2 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:18:28.880035 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-cb901a9f-a572-4c35-ad27-b49fd5e95160 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:28.881061 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-cb901a9f-a572-4c35-ad27-b49fd5e95160 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 6d50352a-fd4f-4ca5-8e13-2519dfbb66a1] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:28.883619 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2e5807df-e21e-40ac-a9e3-94e5a292fe53 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:28.884337 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2e5807df-e21e-40ac-a9e3-94e5a292fe53 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:28.885580 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2e5807df-e21e-40ac-a9e3-94e5a292fe53 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:28.886301 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2e5807df-e21e-40ac-a9e3-94e5a292fe53 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:28.897384 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-cb901a9f-a572-4c35-ad27-b49fd5e95160 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:28.898098 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-cb901a9f-a572-4c35-ad27-b49fd5e95160 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:28.899885 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-cb901a9f-a572-4c35-ad27-b49fd5e95160 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:28.900636 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-cb901a9f-a572-4c35-ad27-b49fd5e95160 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:29.089894 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-cb901a9f-a572-4c35-ad27-b49fd5e95160 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:29.107039 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-cb901a9f-a572-4c35-ad27-b49fd5e95160 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1" status: 200 len: 1735 microversion: 2.1 time: 0.232817 Jul 22 11:18:29.109599 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 275/556] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:28 2022] GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1 => generated 1735 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:18:29.125923 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-bfe96cde-d4e7-40ca-aaa7-46b95b5219cf tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:29.140758 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-bfe96cde-d4e7-40ca-aaa7-46b95b5219cf tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 272976bd-b870-41a6-9bcd-598e1c9d34bc] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:29.171845 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-bfe96cde-d4e7-40ca-aaa7-46b95b5219cf tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:29.173087 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-bfe96cde-d4e7-40ca-aaa7-46b95b5219cf tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:29.174770 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-bfe96cde-d4e7-40ca-aaa7-46b95b5219cf tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:29.174955 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-2e5807df-e21e-40ac-a9e3-94e5a292fe53 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:29.175978 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-bfe96cde-d4e7-40ca-aaa7-46b95b5219cf tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:29.186222 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-2e5807df-e21e-40ac-a9e3-94e5a292fe53 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1675 microversion: 2.1 time: 0.321854 Jul 22 11:18:29.236340 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 282/557] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:28 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1675 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:18:29.324422 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-b33fa5e0-1e0f-41d7-94ae-899e07f54a3d req-de676ef5-981e-46af-b859-3927648a6b2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "272976bd-b870-41a6-9bcd-598e1c9d34bc", "name": "network-vif-plugged", "status": "completed", "tag": "c4d22b99-709d-4d50-a237-82850eeff0a1"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:18:29.336035 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-b33fa5e0-1e0f-41d7-94ae-899e07f54a3d req-de676ef5-981e-46af-b859-3927648a6b2a service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:29.337462 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-b33fa5e0-1e0f-41d7-94ae-899e07f54a3d req-de676ef5-981e-46af-b859-3927648a6b2a service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:29.353495 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-b33fa5e0-1e0f-41d7-94ae-899e07f54a3d req-de676ef5-981e-46af-b859-3927648a6b2a service nova] Creating event network-vif-plugged:c4d22b99-709d-4d50-a237-82850eeff0a1 for instance 272976bd-b870-41a6-9bcd-598e1c9d34bc on hv-cinder-84890 Jul 22 11:18:29.360328 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-b33fa5e0-1e0f-41d7-94ae-899e07f54a3d req-de676ef5-981e-46af-b859-3927648a6b2a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042851 Jul 22 11:18:29.362101 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 283/558] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:18:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:18:29.394316 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-75fa27ac-098d-466a-ad38-e5206bb7d28b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:29.395495 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-75fa27ac-098d-466a-ad38-e5206bb7d28b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:29.408926 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-75fa27ac-098d-466a-ad38-e5206bb7d28b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:29.410939 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-75fa27ac-098d-466a-ad38-e5206bb7d28b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:29.412744 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-75fa27ac-098d-466a-ad38-e5206bb7d28b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:29.413935 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-75fa27ac-098d-466a-ad38-e5206bb7d28b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:29.424612 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-bfe96cde-d4e7-40ca-aaa7-46b95b5219cf tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:29.433318 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-bfe96cde-d4e7-40ca-aaa7-46b95b5219cf tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/272976bd-b870-41a6-9bcd-598e1c9d34bc" status: 200 len: 1366 microversion: 2.1 time: 0.321139 Jul 22 11:18:29.434497 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 276/559] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:29 2022] GET /compute/v2.1/servers/272976bd-b870-41a6-9bcd-598e1c9d34bc => generated 1366 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:18:29.616363 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-75fa27ac-098d-466a-ad38-e5206bb7d28b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:29.626265 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-75fa27ac-098d-466a-ad38-e5206bb7d28b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:29.627806 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-75fa27ac-098d-466a-ad38-e5206bb7d28b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:29.629076 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-75fa27ac-098d-466a-ad38-e5206bb7d28b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54" status: 200 len: 1809 microversion: 2.20 time: 0.239651 Jul 22 11:18:29.629975 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 284/560] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:18:29 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 => generated 1809 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 22 11:18:30.131061 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-9a2cb5be-de05-42c8-bbb8-c05c7296cbe5 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:30.133620 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-9a2cb5be-de05-42c8-bbb8-c05c7296cbe5 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 6d50352a-fd4f-4ca5-8e13-2519dfbb66a1] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:30.148988 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-9a2cb5be-de05-42c8-bbb8-c05c7296cbe5 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:30.150626 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-9a2cb5be-de05-42c8-bbb8-c05c7296cbe5 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:30.152490 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-9a2cb5be-de05-42c8-bbb8-c05c7296cbe5 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:30.153744 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-9a2cb5be-de05-42c8-bbb8-c05c7296cbe5 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:30.215712 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-02f7e14e-1c13-4ceb-9c74-ca7cc9a88ae6 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:30.217850 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-02f7e14e-1c13-4ceb-9c74-ca7cc9a88ae6 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:30.231529 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-02f7e14e-1c13-4ceb-9c74-ca7cc9a88ae6 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:30.233068 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-02f7e14e-1c13-4ceb-9c74-ca7cc9a88ae6 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:30.234669 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-02f7e14e-1c13-4ceb-9c74-ca7cc9a88ae6 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:30.236504 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-02f7e14e-1c13-4ceb-9c74-ca7cc9a88ae6 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:30.431307 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-02f7e14e-1c13-4ceb-9c74-ca7cc9a88ae6 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:30.439972 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-02f7e14e-1c13-4ceb-9c74-ca7cc9a88ae6 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1675 microversion: 2.1 time: 0.232653 Jul 22 11:18:30.440562 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 285/561] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:30 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1675 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:18:30.452600 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-9a2cb5be-de05-42c8-bbb8-c05c7296cbe5 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:30.462440 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-2a8853de-4471-4c4a-8c15-e16c66b261a5 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:30.468953 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-9a2cb5be-de05-42c8-bbb8-c05c7296cbe5 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1" status: 200 len: 1735 microversion: 2.1 time: 0.346236 Jul 22 11:18:30.469289 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-2a8853de-4471-4c4a-8c15-e16c66b261a5 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 272976bd-b870-41a6-9bcd-598e1c9d34bc] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:30.473610 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 277/562] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:30 2022] GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1 => generated 1735 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:18:30.477793 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2a8853de-4471-4c4a-8c15-e16c66b261a5 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:30.478517 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2a8853de-4471-4c4a-8c15-e16c66b261a5 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:30.479542 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2a8853de-4471-4c4a-8c15-e16c66b261a5 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:30.480173 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2a8853de-4471-4c4a-8c15-e16c66b261a5 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:30.661245 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-262bcd3c-7c30-492e-965f-3d1de228143c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:30.662123 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-262bcd3c-7c30-492e-965f-3d1de228143c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:30.669715 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-262bcd3c-7c30-492e-965f-3d1de228143c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:30.670250 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-262bcd3c-7c30-492e-965f-3d1de228143c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:30.671107 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-262bcd3c-7c30-492e-965f-3d1de228143c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:30.671632 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-262bcd3c-7c30-492e-965f-3d1de228143c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:30.726795 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-2a8853de-4471-4c4a-8c15-e16c66b261a5 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:30.739048 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-2a8853de-4471-4c4a-8c15-e16c66b261a5 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/272976bd-b870-41a6-9bcd-598e1c9d34bc" status: 200 len: 1366 microversion: 2.1 time: 0.281096 Jul 22 11:18:30.751330 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 286/563] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:30 2022] GET /compute/v2.1/servers/272976bd-b870-41a6-9bcd-598e1c9d34bc => generated 1366 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:18:30.871119 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-262bcd3c-7c30-492e-965f-3d1de228143c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:30.884942 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-262bcd3c-7c30-492e-965f-3d1de228143c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:30.887601 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-262bcd3c-7c30-492e-965f-3d1de228143c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:30.889412 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-262bcd3c-7c30-492e-965f-3d1de228143c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54" status: 200 len: 1809 microversion: 2.20 time: 0.232466 Jul 22 11:18:30.896233 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 278/564] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:18:30 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 => generated 1809 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:18:31.470100 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-b9b9b1cd-49a1-4694-b3b2-8f0db06fe4d8 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:31.470911 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-b9b9b1cd-49a1-4694-b3b2-8f0db06fe4d8 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:31.479387 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b9b9b1cd-49a1-4694-b3b2-8f0db06fe4d8 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:31.479832 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b9b9b1cd-49a1-4694-b3b2-8f0db06fe4d8 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:31.480603 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b9b9b1cd-49a1-4694-b3b2-8f0db06fe4d8 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:31.481034 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b9b9b1cd-49a1-4694-b3b2-8f0db06fe4d8 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:31.488954 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-1161be5a-ef54-43ec-a81c-555409bf0669 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:31.489901 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-1161be5a-ef54-43ec-a81c-555409bf0669 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 6d50352a-fd4f-4ca5-8e13-2519dfbb66a1] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:31.500860 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-1161be5a-ef54-43ec-a81c-555409bf0669 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:31.501877 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-1161be5a-ef54-43ec-a81c-555409bf0669 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:31.503661 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-1161be5a-ef54-43ec-a81c-555409bf0669 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:31.503661 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-1161be5a-ef54-43ec-a81c-555409bf0669 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:31.707820 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-b9b9b1cd-49a1-4694-b3b2-8f0db06fe4d8 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:31.718431 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-b9b9b1cd-49a1-4694-b3b2-8f0db06fe4d8 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1675 microversion: 2.1 time: 0.252183 Jul 22 11:18:31.730025 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 287/565] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:31 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1675 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:18:31.745764 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-1161be5a-ef54-43ec-a81c-555409bf0669 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:31.754597 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-1161be5a-ef54-43ec-a81c-555409bf0669 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1" status: 200 len: 1735 microversion: 2.1 time: 0.269444 Jul 22 11:18:31.755567 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 279/566] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:31 2022] GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1 => generated 1735 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:18:31.768145 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-a0034379-ab44-4930-871d-5694b7b1a143 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:31.769004 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-a0034379-ab44-4930-871d-5694b7b1a143 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 272976bd-b870-41a6-9bcd-598e1c9d34bc] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:31.777160 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a0034379-ab44-4930-871d-5694b7b1a143 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:31.778004 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a0034379-ab44-4930-871d-5694b7b1a143 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:31.778910 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a0034379-ab44-4930-871d-5694b7b1a143 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:31.779551 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a0034379-ab44-4930-871d-5694b7b1a143 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:31.912421 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-4234a31a-f054-4e6a-8871-3c57d51d51f0 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:31.913864 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-4234a31a-f054-4e6a-8871-3c57d51d51f0 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:31.956886 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-4234a31a-f054-4e6a-8871-3c57d51d51f0 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:31.958209 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-4234a31a-f054-4e6a-8871-3c57d51d51f0 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:31.960142 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-4234a31a-f054-4e6a-8871-3c57d51d51f0 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:31.960823 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-4234a31a-f054-4e6a-8871-3c57d51d51f0 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:31.970891 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-a0034379-ab44-4930-871d-5694b7b1a143 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:31.980801 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-a0034379-ab44-4930-871d-5694b7b1a143 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/272976bd-b870-41a6-9bcd-598e1c9d34bc" status: 200 len: 1366 microversion: 2.1 time: 0.217331 Jul 22 11:18:31.981739 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 288/567] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:31 2022] GET /compute/v2.1/servers/272976bd-b870-41a6-9bcd-598e1c9d34bc => generated 1366 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:18:31.996093 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG dbcounter [-] [117884] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=117884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:18:32.161732 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-4234a31a-f054-4e6a-8871-3c57d51d51f0 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:32.171821 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-4234a31a-f054-4e6a-8871-3c57d51d51f0 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:32.173332 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-4234a31a-f054-4e6a-8871-3c57d51d51f0 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:32.174533 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-4234a31a-f054-4e6a-8871-3c57d51d51f0 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54" status: 200 len: 1809 microversion: 2.20 time: 0.269296 Jul 22 11:18:32.175106 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 280/568] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:18:31 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 => generated 1809 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:18:32.736699 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-8c37a54b-ed7e-4580-bfad-2820aea3bbaf tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:32.737829 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-8c37a54b-ed7e-4580-bfad-2820aea3bbaf tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:32.745133 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8c37a54b-ed7e-4580-bfad-2820aea3bbaf tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:32.745575 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8c37a54b-ed7e-4580-bfad-2820aea3bbaf tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:32.746346 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8c37a54b-ed7e-4580-bfad-2820aea3bbaf tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:32.746772 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8c37a54b-ed7e-4580-bfad-2820aea3bbaf tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:32.777503 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-2c744315-e81a-4c61-be01-697969a8c46e tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:32.778339 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-2c744315-e81a-4c61-be01-697969a8c46e tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 6d50352a-fd4f-4ca5-8e13-2519dfbb66a1] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:32.785078 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-2c744315-e81a-4c61-be01-697969a8c46e tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:32.785521 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-2c744315-e81a-4c61-be01-697969a8c46e tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:32.786375 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-2c744315-e81a-4c61-be01-697969a8c46e tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:32.786831 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-2c744315-e81a-4c61-be01-697969a8c46e tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:32.923693 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-8c37a54b-ed7e-4580-bfad-2820aea3bbaf tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:32.936076 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-8c37a54b-ed7e-4580-bfad-2820aea3bbaf tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1675 microversion: 2.1 time: 0.199335 Jul 22 11:18:32.936076 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 289/569] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:32 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1675 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:18:32.938317 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-2c744315-e81a-4c61-be01-697969a8c46e tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:32.949357 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-2c744315-e81a-4c61-be01-697969a8c46e tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1" status: 200 len: 1735 microversion: 2.1 time: 0.180657 Jul 22 11:18:32.950285 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 281/570] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:32 2022] GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1 => generated 1735 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:18:33.006485 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-f1fbfaa8-fea9-4ce9-9fa5-3ce563070a3e tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:33.007120 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-f1fbfaa8-fea9-4ce9-9fa5-3ce563070a3e tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 272976bd-b870-41a6-9bcd-598e1c9d34bc] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:33.014917 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f1fbfaa8-fea9-4ce9-9fa5-3ce563070a3e tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:33.015629 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f1fbfaa8-fea9-4ce9-9fa5-3ce563070a3e tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:33.016425 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f1fbfaa8-fea9-4ce9-9fa5-3ce563070a3e tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:33.016857 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f1fbfaa8-fea9-4ce9-9fa5-3ce563070a3e tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:33.201321 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-ce9f3a45-b541-434a-8af7-6d1b451d8a83 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:33.202465 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-ce9f3a45-b541-434a-8af7-6d1b451d8a83 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:33.214349 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-ce9f3a45-b541-434a-8af7-6d1b451d8a83 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:33.215196 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-ce9f3a45-b541-434a-8af7-6d1b451d8a83 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:33.221023 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-f1fbfaa8-fea9-4ce9-9fa5-3ce563070a3e tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:33.225347 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-ce9f3a45-b541-434a-8af7-6d1b451d8a83 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:33.225809 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-ce9f3a45-b541-434a-8af7-6d1b451d8a83 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:33.238499 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-f1fbfaa8-fea9-4ce9-9fa5-3ce563070a3e tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/272976bd-b870-41a6-9bcd-598e1c9d34bc" status: 200 len: 1366 microversion: 2.1 time: 0.235373 Jul 22 11:18:33.255331 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 290/571] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:33 2022] GET /compute/v2.1/servers/272976bd-b870-41a6-9bcd-598e1c9d34bc => generated 1366 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:18:33.429681 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-ce9f3a45-b541-434a-8af7-6d1b451d8a83 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:33.442162 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-ce9f3a45-b541-434a-8af7-6d1b451d8a83 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:33.443860 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-ce9f3a45-b541-434a-8af7-6d1b451d8a83 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:33.445149 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-ce9f3a45-b541-434a-8af7-6d1b451d8a83 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54" status: 200 len: 1809 microversion: 2.20 time: 0.252666 Jul 22 11:18:33.445796 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 282/572] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:18:33 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 => generated 1809 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:18:33.952033 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-3b0b57b0-7fb7-43a3-a272-dab811b09b61 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:33.953558 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-3b0b57b0-7fb7-43a3-a272-dab811b09b61 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:33.962310 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3b0b57b0-7fb7-43a3-a272-dab811b09b61 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:33.963055 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3b0b57b0-7fb7-43a3-a272-dab811b09b61 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:33.964339 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3b0b57b0-7fb7-43a3-a272-dab811b09b61 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:33.965071 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3b0b57b0-7fb7-43a3-a272-dab811b09b61 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:33.972613 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-c5630b35-6449-4dc2-8476-bfe2f3a8f011 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:33.973451 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-c5630b35-6449-4dc2-8476-bfe2f3a8f011 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 6d50352a-fd4f-4ca5-8e13-2519dfbb66a1] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:33.984935 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c5630b35-6449-4dc2-8476-bfe2f3a8f011 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:33.985857 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c5630b35-6449-4dc2-8476-bfe2f3a8f011 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:33.987233 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c5630b35-6449-4dc2-8476-bfe2f3a8f011 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:33.988106 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c5630b35-6449-4dc2-8476-bfe2f3a8f011 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:34.162052 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-3b0b57b0-7fb7-43a3-a272-dab811b09b61 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:34.172335 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-3b0b57b0-7fb7-43a3-a272-dab811b09b61 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1675 microversion: 2.1 time: 0.225437 Jul 22 11:18:34.187292 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 291/573] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:33 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1675 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:18:34.187595 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-c5630b35-6449-4dc2-8476-bfe2f3a8f011 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:34.195032 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-c5630b35-6449-4dc2-8476-bfe2f3a8f011 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1" status: 200 len: 1735 microversion: 2.1 time: 0.230326 Jul 22 11:18:34.195693 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 283/574] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:33 2022] GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1 => generated 1735 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:18:34.269106 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-fbdd734b-fade-417b-ba0a-26ae38951d1d tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:34.270288 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-fbdd734b-fade-417b-ba0a-26ae38951d1d tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 272976bd-b870-41a6-9bcd-598e1c9d34bc] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:34.278792 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fbdd734b-fade-417b-ba0a-26ae38951d1d tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:34.279711 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fbdd734b-fade-417b-ba0a-26ae38951d1d tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:34.281043 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fbdd734b-fade-417b-ba0a-26ae38951d1d tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:34.281684 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fbdd734b-fade-417b-ba0a-26ae38951d1d tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:34.462328 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-fbdd734b-fade-417b-ba0a-26ae38951d1d tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:34.466692 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-13a6b2e1-d190-42a9-b0a1-aa175136dc3a tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:34.468094 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-13a6b2e1-d190-42a9-b0a1-aa175136dc3a tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:34.475849 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-fbdd734b-fade-417b-ba0a-26ae38951d1d tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/272976bd-b870-41a6-9bcd-598e1c9d34bc" status: 200 len: 1366 microversion: 2.1 time: 0.211507 Jul 22 11:18:34.477707 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 292/575] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:34 2022] GET /compute/v2.1/servers/272976bd-b870-41a6-9bcd-598e1c9d34bc => generated 1366 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:18:34.478714 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-13a6b2e1-d190-42a9-b0a1-aa175136dc3a tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:34.479465 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-13a6b2e1-d190-42a9-b0a1-aa175136dc3a tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:34.480660 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-13a6b2e1-d190-42a9-b0a1-aa175136dc3a tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:34.481282 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-13a6b2e1-d190-42a9-b0a1-aa175136dc3a tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:34.649251 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-13a6b2e1-d190-42a9-b0a1-aa175136dc3a tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:34.659649 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-13a6b2e1-d190-42a9-b0a1-aa175136dc3a tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:34.661166 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-13a6b2e1-d190-42a9-b0a1-aa175136dc3a tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:34.663482 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-13a6b2e1-d190-42a9-b0a1-aa175136dc3a tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54" status: 200 len: 1809 microversion: 2.20 time: 0.203177 Jul 22 11:18:34.664172 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 284/576] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:18:34 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 => generated 1809 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:18:35.197920 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-6f9f386c-4c2a-46ab-a3c8-b256ab6e1d4c tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:35.198636 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-6f9f386c-4c2a-46ab-a3c8-b256ab6e1d4c tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:35.206205 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6f9f386c-4c2a-46ab-a3c8-b256ab6e1d4c tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:35.206543 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6f9f386c-4c2a-46ab-a3c8-b256ab6e1d4c tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:35.207348 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6f9f386c-4c2a-46ab-a3c8-b256ab6e1d4c tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:35.207783 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6f9f386c-4c2a-46ab-a3c8-b256ab6e1d4c tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:35.219927 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-f12cf554-a6fa-4e2d-bb74-1b983045ca1b tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:35.220992 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-f12cf554-a6fa-4e2d-bb74-1b983045ca1b tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 6d50352a-fd4f-4ca5-8e13-2519dfbb66a1] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:35.232467 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f12cf554-a6fa-4e2d-bb74-1b983045ca1b tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:35.233193 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f12cf554-a6fa-4e2d-bb74-1b983045ca1b tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:35.234752 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f12cf554-a6fa-4e2d-bb74-1b983045ca1b tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:35.235478 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f12cf554-a6fa-4e2d-bb74-1b983045ca1b tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:35.419928 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-6f9f386c-4c2a-46ab-a3c8-b256ab6e1d4c tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:35.435921 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-6f9f386c-4c2a-46ab-a3c8-b256ab6e1d4c tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1675 microversion: 2.1 time: 0.242174 Jul 22 11:18:35.439618 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 293/577] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:35 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1675 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:18:35.499436 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-68cc5411-49c2-49f7-bb51-9bc2cff26b94 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:35.500528 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-68cc5411-49c2-49f7-bb51-9bc2cff26b94 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 272976bd-b870-41a6-9bcd-598e1c9d34bc] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:35.512030 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-68cc5411-49c2-49f7-bb51-9bc2cff26b94 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:35.512887 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-68cc5411-49c2-49f7-bb51-9bc2cff26b94 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:35.514515 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-68cc5411-49c2-49f7-bb51-9bc2cff26b94 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:35.515341 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-68cc5411-49c2-49f7-bb51-9bc2cff26b94 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:35.525687 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=100 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:18:35.541881 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-f12cf554-a6fa-4e2d-bb74-1b983045ca1b tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:35.562938 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-f12cf554-a6fa-4e2d-bb74-1b983045ca1b tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1" status: 200 len: 1735 microversion: 2.1 time: 0.346904 Jul 22 11:18:35.562938 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 285/578] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:35 2022] GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1 => generated 1735 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:18:35.701494 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-d4fc8313-0524-4bd5-bbd2-8ed93220ca8b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:35.703637 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-d4fc8313-0524-4bd5-bbd2-8ed93220ca8b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:35.728260 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-68cc5411-49c2-49f7-bb51-9bc2cff26b94 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:35.731698 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-d4fc8313-0524-4bd5-bbd2-8ed93220ca8b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:35.734073 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-d4fc8313-0524-4bd5-bbd2-8ed93220ca8b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:35.736271 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-d4fc8313-0524-4bd5-bbd2-8ed93220ca8b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:35.737391 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-68cc5411-49c2-49f7-bb51-9bc2cff26b94 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/272976bd-b870-41a6-9bcd-598e1c9d34bc" status: 200 len: 1366 microversion: 2.1 time: 0.245263 Jul 22 11:18:35.737997 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 294/579] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:35 2022] GET /compute/v2.1/servers/272976bd-b870-41a6-9bcd-598e1c9d34bc => generated 1366 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:18:35.738868 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-d4fc8313-0524-4bd5-bbd2-8ed93220ca8b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:35.918078 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-d4fc8313-0524-4bd5-bbd2-8ed93220ca8b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:35.927109 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-d4fc8313-0524-4bd5-bbd2-8ed93220ca8b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:35.928625 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-d4fc8313-0524-4bd5-bbd2-8ed93220ca8b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:35.929778 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-d4fc8313-0524-4bd5-bbd2-8ed93220ca8b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54" status: 200 len: 1809 microversion: 2.20 time: 0.238997 Jul 22 11:18:35.930929 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 286/580] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:18:35 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 => generated 1809 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:18:36.463774 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-193f0216-2d31-4e73-883e-b397915e530e tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:36.464397 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-193f0216-2d31-4e73-883e-b397915e530e tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:36.473259 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-193f0216-2d31-4e73-883e-b397915e530e tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:36.474059 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-193f0216-2d31-4e73-883e-b397915e530e tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:36.475458 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-193f0216-2d31-4e73-883e-b397915e530e tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:36.476236 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-193f0216-2d31-4e73-883e-b397915e530e tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:36.581960 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-0dd79549-73ce-475a-80c9-e499f0aa814e tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:36.581960 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-0dd79549-73ce-475a-80c9-e499f0aa814e tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 6d50352a-fd4f-4ca5-8e13-2519dfbb66a1] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:36.588251 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-0dd79549-73ce-475a-80c9-e499f0aa814e tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:36.588703 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-0dd79549-73ce-475a-80c9-e499f0aa814e tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:36.589474 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-0dd79549-73ce-475a-80c9-e499f0aa814e tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:36.589914 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-0dd79549-73ce-475a-80c9-e499f0aa814e tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:36.679623 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-193f0216-2d31-4e73-883e-b397915e530e tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:36.690016 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-193f0216-2d31-4e73-883e-b397915e530e tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1675 microversion: 2.1 time: 0.230663 Jul 22 11:18:36.691061 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 295/581] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:36 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1675 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:18:36.772484 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-b15fbbe0-9c13-463e-8646-3efd6af7e253 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:36.773094 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-b15fbbe0-9c13-463e-8646-3efd6af7e253 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 272976bd-b870-41a6-9bcd-598e1c9d34bc] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:36.783922 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b15fbbe0-9c13-463e-8646-3efd6af7e253 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:36.784408 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b15fbbe0-9c13-463e-8646-3efd6af7e253 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:36.785130 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b15fbbe0-9c13-463e-8646-3efd6af7e253 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:36.785558 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b15fbbe0-9c13-463e-8646-3efd6af7e253 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:36.797513 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-0dd79549-73ce-475a-80c9-e499f0aa814e tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:36.812158 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-0dd79549-73ce-475a-80c9-e499f0aa814e tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1" status: 200 len: 1735 microversion: 2.1 time: 0.234224 Jul 22 11:18:36.812706 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 287/582] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:36 2022] GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1 => generated 1735 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:18:36.952016 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-a4c5efdd-93b4-485d-85e3-6f1c2459c3e2 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:36.953361 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-a4c5efdd-93b4-485d-85e3-6f1c2459c3e2 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:36.960118 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-a4c5efdd-93b4-485d-85e3-6f1c2459c3e2 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:36.960570 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-a4c5efdd-93b4-485d-85e3-6f1c2459c3e2 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:36.961968 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-a4c5efdd-93b4-485d-85e3-6f1c2459c3e2 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:36.962634 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-a4c5efdd-93b4-485d-85e3-6f1c2459c3e2 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:36.971220 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-b15fbbe0-9c13-463e-8646-3efd6af7e253 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:36.984396 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-b15fbbe0-9c13-463e-8646-3efd6af7e253 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/272976bd-b870-41a6-9bcd-598e1c9d34bc" status: 200 len: 1366 microversion: 2.1 time: 0.215657 Jul 22 11:18:36.985312 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 296/583] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:36 2022] GET /compute/v2.1/servers/272976bd-b870-41a6-9bcd-598e1c9d34bc => generated 1366 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:18:37.145566 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-a4c5efdd-93b4-485d-85e3-6f1c2459c3e2 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:37.155310 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-a4c5efdd-93b4-485d-85e3-6f1c2459c3e2 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:37.157558 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-a4c5efdd-93b4-485d-85e3-6f1c2459c3e2 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:37.159130 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-a4c5efdd-93b4-485d-85e3-6f1c2459c3e2 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54" status: 200 len: 1809 microversion: 2.20 time: 0.213534 Jul 22 11:18:37.159976 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 288/584] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:18:36 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 => generated 1809 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:18:37.707875 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-3b8432c2-2cb1-4948-a9e0-274e39156c93 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:37.708586 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-3b8432c2-2cb1-4948-a9e0-274e39156c93 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:37.714685 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3b8432c2-2cb1-4948-a9e0-274e39156c93 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:37.715129 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3b8432c2-2cb1-4948-a9e0-274e39156c93 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:37.715941 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3b8432c2-2cb1-4948-a9e0-274e39156c93 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:37.716365 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3b8432c2-2cb1-4948-a9e0-274e39156c93 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:37.829697 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-c58172fb-6ddb-43ea-8b4a-f5d0a3a2dd60 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:37.830338 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-c58172fb-6ddb-43ea-8b4a-f5d0a3a2dd60 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 6d50352a-fd4f-4ca5-8e13-2519dfbb66a1] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:37.837269 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c58172fb-6ddb-43ea-8b4a-f5d0a3a2dd60 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:37.837710 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c58172fb-6ddb-43ea-8b4a-f5d0a3a2dd60 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:37.838472 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c58172fb-6ddb-43ea-8b4a-f5d0a3a2dd60 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:37.838895 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c58172fb-6ddb-43ea-8b4a-f5d0a3a2dd60 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:37.869095 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-3b8432c2-2cb1-4948-a9e0-274e39156c93 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:37.878849 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-3b8432c2-2cb1-4948-a9e0-274e39156c93 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1675 microversion: 2.1 time: 0.174889 Jul 22 11:18:37.890554 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 297/585] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:37 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1675 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:18:37.995586 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-c58172fb-6ddb-43ea-8b4a-f5d0a3a2dd60 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:38.002053 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-62f21089-ab42-4a09-acfc-3372c8d9ac05 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:38.002882 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-62f21089-ab42-4a09-acfc-3372c8d9ac05 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 272976bd-b870-41a6-9bcd-598e1c9d34bc] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:38.007546 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-c58172fb-6ddb-43ea-8b4a-f5d0a3a2dd60 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1" status: 200 len: 1735 microversion: 2.1 time: 0.181620 Jul 22 11:18:38.008178 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 289/586] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:37 2022] GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1 => generated 1735 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:18:38.009609 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-62f21089-ab42-4a09-acfc-3372c8d9ac05 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:38.010058 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-62f21089-ab42-4a09-acfc-3372c8d9ac05 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:38.010850 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-62f21089-ab42-4a09-acfc-3372c8d9ac05 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:38.011319 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-62f21089-ab42-4a09-acfc-3372c8d9ac05 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:38.178789 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-1951c4fe-4ef7-4001-829b-c8afea145406 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:38.179410 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-1951c4fe-4ef7-4001-829b-c8afea145406 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:38.186545 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-1951c4fe-4ef7-4001-829b-c8afea145406 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:38.186994 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-1951c4fe-4ef7-4001-829b-c8afea145406 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:38.187812 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-1951c4fe-4ef7-4001-829b-c8afea145406 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:38.188246 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-1951c4fe-4ef7-4001-829b-c8afea145406 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:38.334430 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-1951c4fe-4ef7-4001-829b-c8afea145406 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:38.344474 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-1951c4fe-4ef7-4001-829b-c8afea145406 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:38.345997 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-1951c4fe-4ef7-4001-829b-c8afea145406 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:38.347229 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-1951c4fe-4ef7-4001-829b-c8afea145406 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54" status: 200 len: 1809 microversion: 2.20 time: 0.172505 Jul 22 11:18:38.347805 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 290/587] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:18:38 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 22 11:18:38.381895 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-62f21089-ab42-4a09-acfc-3372c8d9ac05 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:38.390255 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-62f21089-ab42-4a09-acfc-3372c8d9ac05 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/272976bd-b870-41a6-9bcd-598e1c9d34bc" status: 200 len: 1366 microversion: 2.1 time: 0.392187 Jul 22 11:18:38.390861 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 298/588] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:37 2022] GET /compute/v2.1/servers/272976bd-b870-41a6-9bcd-598e1c9d34bc => generated 1366 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:18:38.902289 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-c5ac65b8-a33f-413c-8f52-4681d9f3f458 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:38.903103 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-c5ac65b8-a33f-413c-8f52-4681d9f3f458 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:38.910122 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c5ac65b8-a33f-413c-8f52-4681d9f3f458 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:38.910576 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c5ac65b8-a33f-413c-8f52-4681d9f3f458 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:38.911399 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c5ac65b8-a33f-413c-8f52-4681d9f3f458 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:38.911837 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c5ac65b8-a33f-413c-8f52-4681d9f3f458 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:39.026313 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-01dc26c0-b442-4e40-b015-72294bd474cd tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:39.027225 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-01dc26c0-b442-4e40-b015-72294bd474cd tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 6d50352a-fd4f-4ca5-8e13-2519dfbb66a1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:39.034348 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-01dc26c0-b442-4e40-b015-72294bd474cd tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:39.034792 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-01dc26c0-b442-4e40-b015-72294bd474cd tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:39.035637 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-01dc26c0-b442-4e40-b015-72294bd474cd tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:39.036198 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-01dc26c0-b442-4e40-b015-72294bd474cd tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:39.096838 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-c5ac65b8-a33f-413c-8f52-4681d9f3f458 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:39.107566 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-c5ac65b8-a33f-413c-8f52-4681d9f3f458 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1652 microversion: 2.1 time: 0.209171 Jul 22 11:18:39.108456 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 291/589] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:38 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1652 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:18:39.127854 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-db4495b8-cfa0-4803-9e87-bfe1f5d3f95a tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:18:39.134477 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-db4495b8-cfa0-4803-9e87-bfe1f5d3f95a tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:39.134990 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-db4495b8-cfa0-4803-9e87-bfe1f5d3f95a tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:39.161464 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-db4495b8-cfa0-4803-9e87-bfe1f5d3f95a tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Going to try to start instance {{(pid=117884) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 22 11:18:39.193616 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-01dc26c0-b442-4e40-b015-72294bd474cd tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:39.202166 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-01dc26c0-b442-4e40-b015-72294bd474cd tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1" status: 200 len: 1735 microversion: 2.1 time: 0.180330 Jul 22 11:18:39.202812 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 299/590] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:39 2022] GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1 => generated 1735 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:18:39.206078 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-db4495b8-cfa0-4803-9e87-bfe1f5d3f95a tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "POST /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1/action" status: 202 len: 0 microversion: 2.1 time: 0.082808 Jul 22 11:18:39.206974 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 292/591] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Jul 22 11:18:39 2022] POST /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 22 11:18:39.215494 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-32b63232-d0d4-46c8-9020-23761ad7d1af tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:39.216194 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-32b63232-d0d4-46c8-9020-23761ad7d1af tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:39.222434 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-32b63232-d0d4-46c8-9020-23761ad7d1af tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:39.222656 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-32b63232-d0d4-46c8-9020-23761ad7d1af tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:39.223444 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-32b63232-d0d4-46c8-9020-23761ad7d1af tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:39.223873 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-32b63232-d0d4-46c8-9020-23761ad7d1af tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:39.366263 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-2b9f99cf-817b-4696-9202-6b15fa41ef75 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:39.366957 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-2b9f99cf-817b-4696-9202-6b15fa41ef75 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:39.373258 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-2b9f99cf-817b-4696-9202-6b15fa41ef75 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:39.373701 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-2b9f99cf-817b-4696-9202-6b15fa41ef75 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:39.374753 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-2b9f99cf-817b-4696-9202-6b15fa41ef75 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:39.375210 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-2b9f99cf-817b-4696-9202-6b15fa41ef75 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:39.378750 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-32b63232-d0d4-46c8-9020-23761ad7d1af tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:39.390934 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-32b63232-d0d4-46c8-9020-23761ad7d1af tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1661 microversion: 2.1 time: 0.180006 Jul 22 11:18:39.391735 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 300/592] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:39 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1661 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:18:39.409269 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-50f34d73-ab02-43d2-8402-4038b7cf3143 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:39.409911 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-50f34d73-ab02-43d2-8402-4038b7cf3143 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 272976bd-b870-41a6-9bcd-598e1c9d34bc] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:39.420324 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-50f34d73-ab02-43d2-8402-4038b7cf3143 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:39.421102 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-50f34d73-ab02-43d2-8402-4038b7cf3143 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:39.422418 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-50f34d73-ab02-43d2-8402-4038b7cf3143 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:39.423178 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-50f34d73-ab02-43d2-8402-4038b7cf3143 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:39.542888 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-2b9f99cf-817b-4696-9202-6b15fa41ef75 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:39.556329 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-2b9f99cf-817b-4696-9202-6b15fa41ef75 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:39.557889 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-2b9f99cf-817b-4696-9202-6b15fa41ef75 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:39.559420 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-2b9f99cf-817b-4696-9202-6b15fa41ef75 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54" status: 200 len: 1809 microversion: 2.20 time: 0.197542 Jul 22 11:18:39.559999 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 293/593] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:18:39 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 => generated 1809 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:18:39.588778 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-50f34d73-ab02-43d2-8402-4038b7cf3143 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:39.607205 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-50f34d73-ab02-43d2-8402-4038b7cf3143 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/272976bd-b870-41a6-9bcd-598e1c9d34bc" status: 200 len: 1366 microversion: 2.1 time: 0.199143 Jul 22 11:18:39.607205 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 301/594] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:39 2022] GET /compute/v2.1/servers/272976bd-b870-41a6-9bcd-598e1c9d34bc => generated 1366 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:18:40.219645 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-3970ede1-10d0-4307-a08b-a8526fa1a3cd tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:40.220314 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-3970ede1-10d0-4307-a08b-a8526fa1a3cd tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 6d50352a-fd4f-4ca5-8e13-2519dfbb66a1] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:40.226708 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-3970ede1-10d0-4307-a08b-a8526fa1a3cd tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:40.227152 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-3970ede1-10d0-4307-a08b-a8526fa1a3cd tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:40.227942 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-3970ede1-10d0-4307-a08b-a8526fa1a3cd tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:40.228371 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-3970ede1-10d0-4307-a08b-a8526fa1a3cd tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:40.368320 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-3970ede1-10d0-4307-a08b-a8526fa1a3cd tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:40.379584 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-3970ede1-10d0-4307-a08b-a8526fa1a3cd tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1" status: 200 len: 1735 microversion: 2.1 time: 0.163820 Jul 22 11:18:40.380179 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 294/595] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:40 2022] GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:18:40.409059 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-e99a1554-3747-4bdd-b706-73cb4e350107 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:40.409661 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-e99a1554-3747-4bdd-b706-73cb4e350107 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:40.416613 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e99a1554-3747-4bdd-b706-73cb4e350107 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:40.417047 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e99a1554-3747-4bdd-b706-73cb4e350107 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:40.417803 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e99a1554-3747-4bdd-b706-73cb4e350107 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:40.418228 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e99a1554-3747-4bdd-b706-73cb4e350107 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:40.557406 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-e99a1554-3747-4bdd-b706-73cb4e350107 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:40.565408 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-e99a1554-3747-4bdd-b706-73cb4e350107 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1661 microversion: 2.1 time: 0.160068 Jul 22 11:18:40.565995 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 302/596] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:40 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1661 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:18:40.579065 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-ff137614-8712-4718-8b85-616a20ed9a7b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:40.579794 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-ff137614-8712-4718-8b85-616a20ed9a7b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:40.586130 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-ff137614-8712-4718-8b85-616a20ed9a7b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:40.586604 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-ff137614-8712-4718-8b85-616a20ed9a7b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:40.587408 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-ff137614-8712-4718-8b85-616a20ed9a7b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:40.587844 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-ff137614-8712-4718-8b85-616a20ed9a7b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:40.626614 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-928fe263-2c09-4d22-a122-596b86a632f8 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:40.627340 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-928fe263-2c09-4d22-a122-596b86a632f8 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 272976bd-b870-41a6-9bcd-598e1c9d34bc] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:40.633921 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-928fe263-2c09-4d22-a122-596b86a632f8 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:40.634484 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-928fe263-2c09-4d22-a122-596b86a632f8 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:40.635370 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-928fe263-2c09-4d22-a122-596b86a632f8 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:40.635879 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-928fe263-2c09-4d22-a122-596b86a632f8 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:40.734625 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-ff137614-8712-4718-8b85-616a20ed9a7b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:40.748182 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-ff137614-8712-4718-8b85-616a20ed9a7b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:40.749704 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-ff137614-8712-4718-8b85-616a20ed9a7b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:40.750886 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-ff137614-8712-4718-8b85-616a20ed9a7b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54" status: 200 len: 1809 microversion: 2.20 time: 0.176510 Jul 22 11:18:40.751513 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 295/597] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:18:40 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 => generated 1809 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:18:40.784618 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-928fe263-2c09-4d22-a122-596b86a632f8 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:40.793469 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-928fe263-2c09-4d22-a122-596b86a632f8 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/272976bd-b870-41a6-9bcd-598e1c9d34bc" status: 200 len: 1366 microversion: 2.1 time: 0.170740 Jul 22 11:18:40.794051 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 303/598] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:40 2022] GET /compute/v2.1/servers/272976bd-b870-41a6-9bcd-598e1c9d34bc => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:18:41.397376 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-2601399f-102d-4d1a-942d-aff6255f1e85 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:41.398067 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-2601399f-102d-4d1a-942d-aff6255f1e85 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 6d50352a-fd4f-4ca5-8e13-2519dfbb66a1] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:41.406551 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-2601399f-102d-4d1a-942d-aff6255f1e85 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:41.407236 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-2601399f-102d-4d1a-942d-aff6255f1e85 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:41.408225 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-2601399f-102d-4d1a-942d-aff6255f1e85 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:41.408907 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-2601399f-102d-4d1a-942d-aff6255f1e85 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:41.413476 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG dbcounter [-] [117884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:18:41.584443 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-cc941840-0752-4bf1-a48c-ceb4795a46a8 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:41.584919 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-cc941840-0752-4bf1-a48c-ceb4795a46a8 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:41.591674 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-cc941840-0752-4bf1-a48c-ceb4795a46a8 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:41.592126 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-cc941840-0752-4bf1-a48c-ceb4795a46a8 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:41.592925 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-cc941840-0752-4bf1-a48c-ceb4795a46a8 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:41.593360 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-cc941840-0752-4bf1-a48c-ceb4795a46a8 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:41.657938 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-2601399f-102d-4d1a-942d-aff6255f1e85 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:41.669437 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-2601399f-102d-4d1a-942d-aff6255f1e85 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1" status: 200 len: 1735 microversion: 2.1 time: 0.275873 Jul 22 11:18:41.670212 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 296/599] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:41 2022] GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1 => generated 1735 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:18:41.737656 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-cc941840-0752-4bf1-a48c-ceb4795a46a8 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:41.744135 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-cc941840-0752-4bf1-a48c-ceb4795a46a8 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1661 microversion: 2.1 time: 0.164881 Jul 22 11:18:41.744863 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 304/600] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:41 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1661 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:18:41.773522 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-2dd12d1e-ba38-4f47-9530-178c9228b2cd tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:41.774163 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-2dd12d1e-ba38-4f47-9530-178c9228b2cd tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:41.776264 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG dbcounter [-] [117884] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:18:41.782712 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-2dd12d1e-ba38-4f47-9530-178c9228b2cd tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:41.783408 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-2dd12d1e-ba38-4f47-9530-178c9228b2cd tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:41.784646 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-2dd12d1e-ba38-4f47-9530-178c9228b2cd tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:41.785307 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-2dd12d1e-ba38-4f47-9530-178c9228b2cd tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:41.813424 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-4c88cb0a-b094-4fe0-92d8-21ee08abc738 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:41.814178 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-4c88cb0a-b094-4fe0-92d8-21ee08abc738 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 272976bd-b870-41a6-9bcd-598e1c9d34bc] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:41.820669 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4c88cb0a-b094-4fe0-92d8-21ee08abc738 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:41.821795 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4c88cb0a-b094-4fe0-92d8-21ee08abc738 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:41.823000 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4c88cb0a-b094-4fe0-92d8-21ee08abc738 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:41.823626 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4c88cb0a-b094-4fe0-92d8-21ee08abc738 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:41.931019 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-2dd12d1e-ba38-4f47-9530-178c9228b2cd tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:41.940858 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-2dd12d1e-ba38-4f47-9530-178c9228b2cd tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:41.943317 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-2dd12d1e-ba38-4f47-9530-178c9228b2cd tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:41.943565 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-2dd12d1e-ba38-4f47-9530-178c9228b2cd tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54" status: 200 len: 1809 microversion: 2.20 time: 0.174041 Jul 22 11:18:41.944331 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 297/601] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:18:41 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:18:41.976121 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-4c88cb0a-b094-4fe0-92d8-21ee08abc738 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:41.988460 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-4c88cb0a-b094-4fe0-92d8-21ee08abc738 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/272976bd-b870-41a6-9bcd-598e1c9d34bc" status: 200 len: 1366 microversion: 2.1 time: 0.181610 Jul 22 11:18:41.989715 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 305/602] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:41 2022] GET /compute/v2.1/servers/272976bd-b870-41a6-9bcd-598e1c9d34bc => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:18:42.686728 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-3edfe46b-e59d-4afe-93e1-4bfa32b32a53 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:42.687371 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-3edfe46b-e59d-4afe-93e1-4bfa32b32a53 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 6d50352a-fd4f-4ca5-8e13-2519dfbb66a1] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:42.694090 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-3edfe46b-e59d-4afe-93e1-4bfa32b32a53 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:42.694526 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-3edfe46b-e59d-4afe-93e1-4bfa32b32a53 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:42.695323 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-3edfe46b-e59d-4afe-93e1-4bfa32b32a53 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:42.696280 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-3edfe46b-e59d-4afe-93e1-4bfa32b32a53 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:42.763112 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-c7b88ad4-a122-420d-9d55-65038537ea7f tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:42.763822 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-c7b88ad4-a122-420d-9d55-65038537ea7f tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:42.766120 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_api:SELECT=100 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:18:42.775113 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c7b88ad4-a122-420d-9d55-65038537ea7f tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:42.775852 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c7b88ad4-a122-420d-9d55-65038537ea7f tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:42.776800 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c7b88ad4-a122-420d-9d55-65038537ea7f tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:42.777414 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c7b88ad4-a122-420d-9d55-65038537ea7f tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:42.881993 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-3edfe46b-e59d-4afe-93e1-4bfa32b32a53 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:42.901303 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-3edfe46b-e59d-4afe-93e1-4bfa32b32a53 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1" status: 200 len: 1735 microversion: 2.1 time: 0.217755 Jul 22 11:18:42.904361 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 298/603] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:42 2022] GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1 => generated 1735 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:18:42.946956 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-c7b88ad4-a122-420d-9d55-65038537ea7f tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:42.954793 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-c7b88ad4-a122-420d-9d55-65038537ea7f tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1661 microversion: 2.1 time: 0.196563 Jul 22 11:18:42.955613 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 306/604] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:42 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1661 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:18:42.964441 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-62993647-40ef-49a6-bcee-5547c24a70fc tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:42.965240 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-62993647-40ef-49a6-bcee-5547c24a70fc tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:42.974078 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-62993647-40ef-49a6-bcee-5547c24a70fc tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:42.974685 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-62993647-40ef-49a6-bcee-5547c24a70fc tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:42.975775 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-62993647-40ef-49a6-bcee-5547c24a70fc tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:42.976349 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-62993647-40ef-49a6-bcee-5547c24a70fc tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:43.012039 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-efa81489-f587-4238-b628-113e70ffd405 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:43.012999 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-efa81489-f587-4238-b628-113e70ffd405 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 272976bd-b870-41a6-9bcd-598e1c9d34bc] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:43.019010 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-efa81489-f587-4238-b628-113e70ffd405 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:43.019393 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-efa81489-f587-4238-b628-113e70ffd405 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:43.020176 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-efa81489-f587-4238-b628-113e70ffd405 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:43.020600 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-efa81489-f587-4238-b628-113e70ffd405 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:43.200814 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-efa81489-f587-4238-b628-113e70ffd405 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:43.209614 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-62993647-40ef-49a6-bcee-5547c24a70fc tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:43.210011 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-efa81489-f587-4238-b628-113e70ffd405 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/272976bd-b870-41a6-9bcd-598e1c9d34bc" status: 200 len: 1556 microversion: 2.1 time: 0.202594 Jul 22 11:18:43.210915 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 307/605] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:43 2022] GET /compute/v2.1/servers/272976bd-b870-41a6-9bcd-598e1c9d34bc => generated 1556 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:18:43.223818 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-62993647-40ef-49a6-bcee-5547c24a70fc tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:43.225331 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-62993647-40ef-49a6-bcee-5547c24a70fc tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:43.226012 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-150d8582-75b9-4791-a754-7fd1aad60e73 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:43.226670 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-150d8582-75b9-4791-a754-7fd1aad60e73 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 272976bd-b870-41a6-9bcd-598e1c9d34bc] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:43.226884 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-62993647-40ef-49a6-bcee-5547c24a70fc tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54" status: 200 len: 1809 microversion: 2.20 time: 0.268199 Jul 22 11:18:43.227429 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 299/606] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:18:42 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 => generated 1809 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:18:43.232882 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-150d8582-75b9-4791-a754-7fd1aad60e73 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:43.233325 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-150d8582-75b9-4791-a754-7fd1aad60e73 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:43.234141 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-150d8582-75b9-4791-a754-7fd1aad60e73 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:43.234584 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-150d8582-75b9-4791-a754-7fd1aad60e73 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:43.317437 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-150d8582-75b9-4791-a754-7fd1aad60e73 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/272976bd-b870-41a6-9bcd-598e1c9d34bc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094909 Jul 22 11:18:43.318415 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 308/607] 10.222.0.20 () {58 vars in 1274 bytes} [Fri Jul 22 11:18:43 2022] GET /compute/v2.1/servers/272976bd-b870-41a6-9bcd-598e1c9d34bc/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 22 11:18:43.922692 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-b2bfc4ea-e6b8-4b1b-b0f2-023bc5340567 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:43.923647 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-b2bfc4ea-e6b8-4b1b-b0f2-023bc5340567 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 6d50352a-fd4f-4ca5-8e13-2519dfbb66a1] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:43.933717 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-b2bfc4ea-e6b8-4b1b-b0f2-023bc5340567 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:43.934716 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-b2bfc4ea-e6b8-4b1b-b0f2-023bc5340567 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:43.936367 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-b2bfc4ea-e6b8-4b1b-b0f2-023bc5340567 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:43.937085 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-b2bfc4ea-e6b8-4b1b-b0f2-023bc5340567 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:43.977397 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-b224997d-c98d-4852-9746-1dcd96da4904 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:43.978562 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-b224997d-c98d-4852-9746-1dcd96da4904 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:43.987807 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b224997d-c98d-4852-9746-1dcd96da4904 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:43.988328 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b224997d-c98d-4852-9746-1dcd96da4904 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:43.989160 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b224997d-c98d-4852-9746-1dcd96da4904 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:43.989895 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b224997d-c98d-4852-9746-1dcd96da4904 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:44.166953 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-b224997d-c98d-4852-9746-1dcd96da4904 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:44.179372 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-b224997d-c98d-4852-9746-1dcd96da4904 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1661 microversion: 2.1 time: 0.208959 Jul 22 11:18:44.179977 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 309/608] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:43 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1661 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:18:44.253106 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-f89ec171-15fd-40fa-8b25-1848d042397d tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:44.254774 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-f89ec171-15fd-40fa-8b25-1848d042397d tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:44.270637 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f89ec171-15fd-40fa-8b25-1848d042397d tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:44.271818 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f89ec171-15fd-40fa-8b25-1848d042397d tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:44.273422 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f89ec171-15fd-40fa-8b25-1848d042397d tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:44.275105 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f89ec171-15fd-40fa-8b25-1848d042397d tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:44.356622 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-b2bfc4ea-e6b8-4b1b-b0f2-023bc5340567 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:44.374469 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-b2bfc4ea-e6b8-4b1b-b0f2-023bc5340567 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1" status: 200 len: 1715 microversion: 2.1 time: 0.457790 Jul 22 11:18:44.375585 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 300/609] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:43 2022] GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1 => generated 1715 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:18:44.473816 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-f89ec171-15fd-40fa-8b25-1848d042397d tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:44.491000 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-f89ec171-15fd-40fa-8b25-1848d042397d tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:44.494075 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-f89ec171-15fd-40fa-8b25-1848d042397d tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:44.496365 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-f89ec171-15fd-40fa-8b25-1848d042397d tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54" status: 200 len: 1809 microversion: 2.20 time: 0.251147 Jul 22 11:18:44.497545 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 310/610] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:18:44 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 => generated 1809 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:18:44.520197 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-79bb2152-337b-4c7e-9e21-31e7ad165819 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:44.520864 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-79bb2152-337b-4c7e-9e21-31e7ad165819 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 6d50352a-fd4f-4ca5-8e13-2519dfbb66a1] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:44.527560 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-79bb2152-337b-4c7e-9e21-31e7ad165819 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:44.528014 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-79bb2152-337b-4c7e-9e21-31e7ad165819 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:44.528779 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-79bb2152-337b-4c7e-9e21-31e7ad165819 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:44.529215 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-79bb2152-337b-4c7e-9e21-31e7ad165819 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:44.643208 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.wsgi [None req-79bb2152-337b-4c7e-9e21-31e7ad165819 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] HTTP exception thrown: Cannot 'detach_volume' instance 6d50352a-fd4f-4ca5-8e13-2519dfbb66a1 while it is in vm_state rescued Jul 22 11:18:44.645073 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-79bb2152-337b-4c7e-9e21-31e7ad165819 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Request method failure captured: Jul 22 11:18:44.645073 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: request: DELETE /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1/os-volume_attachments/97e32901-9964-4317-840e-1d0bc7be9091 HTTP/1.1 Jul 22 11:18:44.645073 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Accept: application/json Jul 22 11:18:44.645073 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Accept-Encoding: identity Jul 22 11:18:44.645073 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Connection: close Jul 22 11:18:44.645073 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Content-Length: 0 Jul 22 11:18:44.645073 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Content-Type: application/json Jul 22 11:18:44.645073 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Host: 10.222.0.20 Jul 22 11:18:44.645073 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Openstack-System-Scope: None Jul 22 11:18:44.645073 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: User-Agent: python-urllib3/1.26.9 Jul 22 11:18:44.645073 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Auth-Token: gAAAAABi2oZ_Qtszk4MNpu9uH6l3EUMK_AOOmV9E0vuS3FH7JkDwedj0MokFDNI6ti-i3aiOV4rP5TlBIaseQX6BcCMnHyQc2puFc3igItuqN6Fa-5lAd9CC5ZoEig99yVdCpczVS8L09dtiY0BgUBiyP4qmW8wj6-arLdMtONe-36WcUI5-aNY Jul 22 11:18:44.645073 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Domain-Id: None Jul 22 11:18:44.645073 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Domain-Name: None Jul 22 11:18:44.645073 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Identity-Status: Confirmed Jul 22 11:18:44.645073 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Is-Admin-Project: True Jul 22 11:18:44.645073 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Domain-Id: default Jul 22 11:18:44.645073 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Domain-Name: Default Jul 22 11:18:44.645073 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Id: 601d12851417478a8b39bbf0c9fcd03d Jul 22 11:18:44.645073 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-821389900 Jul 22 11:18:44.645073 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Role: reader,member Jul 22 11:18:44.645073 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Roles: reader,member Jul 22 11:18:44.647988 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/601d12851417478a8b39bbf0c9fcd03d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_601d12851417478a8b39bbf0c9fcd03d", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/601d12851417478a8b39bbf0c9fcd03d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/601d12851417478a8b39bbf0c9fcd03d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jul 22 11:18:44.647988 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant: tempest-ServerRescueNegativeTestJSON-821389900 Jul 22 11:18:44.647988 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant-Id: 601d12851417478a8b39bbf0c9fcd03d Jul 22 11:18:44.647988 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-821389900 Jul 22 11:18:44.647988 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User: tempest-ServerRescueNegativeTestJSON-821389900-project Jul 22 11:18:44.647988 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Domain-Id: default Jul 22 11:18:44.647988 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Domain-Name: Default Jul 22 11:18:44.647988 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Id: 7c2c0270618240de8fd9290d01a7413a Jul 22 11:18:44.647988 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Name: tempest-ServerRescueNegativeTestJSON-821389900-project Jul 22 11:18:44.647988 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: method: > Jul 22 11:18:44.647988 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: exception: Cannot 'detach_volume' instance 6d50352a-fd4f-4ca5-8e13-2519dfbb66a1 while it is in vm_state rescued Jul 22 11:18:44.649274 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: action_args: {'server_id': '6d50352a-fd4f-4ca5-8e13-2519dfbb66a1', 'id': '97e32901-9964-4317-840e-1d0bc7be9091'} Jul 22 11:18:44.649274 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 22 11:18:44.649274 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:18:44.649274 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 22 11:18:44.649274 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 22 11:18:44.649274 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 22 11:18:44.649274 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 22 11:18:44.649274 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 22 11:18:44.649274 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 22 11:18:44.649274 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6d50352a-fd4f-4ca5-8e13-2519dfbb66a1 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 22 11:18:44.649274 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:18:44.649274 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:18:44.649274 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:18:44.649274 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:18:44.649274 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:18:44.649274 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:18:44.649274 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 22 11:18:44.649274 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 22 11:18:44.649274 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 22 11:18:44.649274 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 22 11:18:44.651706 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 22 11:18:44.651706 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 22 11:18:44.651706 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 22 11:18:44.651706 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 22 11:18:44.651706 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 6d50352a-fd4f-4ca5-8e13-2519dfbb66a1 while it is in vm_state rescued Jul 22 11:18:44.651706 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:18:44.651706 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:18:44.651706 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:18:44.651706 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:18:44.651706 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:18:44.651706 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:18:44.651706 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 22 11:18:44.651706 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 22 11:18:44.651706 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 6d50352a-fd4f-4ca5-8e13-2519dfbb66a1 while it is in vm_state rescued Jul 22 11:18:44.651706 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:18:44.651706 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-79bb2152-337b-4c7e-9e21-31e7ad165819 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Returning 409 to user: Cannot 'detach_volume' instance 6d50352a-fd4f-4ca5-8e13-2519dfbb66a1 while it is in vm_state rescued {{(pid=117884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 22 11:18:44.653521 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-79bb2152-337b-4c7e-9e21-31e7ad165819 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1/os-volume_attachments/97e32901-9964-4317-840e-1d0bc7be9091" status: 409 len: 152 microversion: 2.1 time: 0.131070 Jul 22 11:18:44.653521 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 301/611] 10.222.0.20 () {58 vars in 1415 bytes} [Fri Jul 22 11:18:44 2022] DELETE /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1/os-volume_attachments/97e32901-9964-4317-840e-1d0bc7be9091 => generated 152 bytes in 133 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 22 11:18:44.668208 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-54d7ebe2-7db8-4509-832a-f5b63a3fadd2 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:18:44.668763 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-54d7ebe2-7db8-4509-832a-f5b63a3fadd2 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 6d50352a-fd4f-4ca5-8e13-2519dfbb66a1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:44.675293 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-54d7ebe2-7db8-4509-832a-f5b63a3fadd2 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:44.675769 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-54d7ebe2-7db8-4509-832a-f5b63a3fadd2 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:44.676549 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-54d7ebe2-7db8-4509-832a-f5b63a3fadd2 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:44.676987 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-54d7ebe2-7db8-4509-832a-f5b63a3fadd2 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:44.681526 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=100 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:18:44.766531 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-54d7ebe2-7db8-4509-832a-f5b63a3fadd2 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "POST /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1/action" status: 202 len: 0 microversion: 2.1 time: 0.110278 Jul 22 11:18:44.771483 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 311/612] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Jul 22 11:18:44 2022] POST /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 22 11:18:44.781741 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-9bcdafb2-d4f8-4dcf-b77c-a6f4e51e0b84 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:44.783831 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-9bcdafb2-d4f8-4dcf-b77c-a6f4e51e0b84 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 6d50352a-fd4f-4ca5-8e13-2519dfbb66a1] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:44.794460 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-9bcdafb2-d4f8-4dcf-b77c-a6f4e51e0b84 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:44.795309 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-9bcdafb2-d4f8-4dcf-b77c-a6f4e51e0b84 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:44.796962 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-9bcdafb2-d4f8-4dcf-b77c-a6f4e51e0b84 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:44.797712 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-9bcdafb2-d4f8-4dcf-b77c-a6f4e51e0b84 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:44.811252 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-413d0d7c-a905-4f62-b147-c7c813077967 req-300a353c-0acc-4779-8bd3-6f4b01c0a726 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "272976bd-b870-41a6-9bcd-598e1c9d34bc", "tag": "c4d22b99-709d-4d50-a237-82850eeff0a1"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:18:44.827655 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-413d0d7c-a905-4f62-b147-c7c813077967 req-300a353c-0acc-4779-8bd3-6f4b01c0a726 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:44.828579 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-413d0d7c-a905-4f62-b147-c7c813077967 req-300a353c-0acc-4779-8bd3-6f4b01c0a726 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:44.852078 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-413d0d7c-a905-4f62-b147-c7c813077967 req-300a353c-0acc-4779-8bd3-6f4b01c0a726 service nova] Creating event network-changed:c4d22b99-709d-4d50-a237-82850eeff0a1 for instance 272976bd-b870-41a6-9bcd-598e1c9d34bc on hv-cinder-84890 Jul 22 11:18:44.861044 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-413d0d7c-a905-4f62-b147-c7c813077967 req-300a353c-0acc-4779-8bd3-6f4b01c0a726 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056396 Jul 22 11:18:44.862531 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 312/613] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:18:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:18:45.017595 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-9bcdafb2-d4f8-4dcf-b77c-a6f4e51e0b84 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:45.034139 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-9bcdafb2-d4f8-4dcf-b77c-a6f4e51e0b84 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1" status: 200 len: 1723 microversion: 2.1 time: 0.259269 Jul 22 11:18:45.035177 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 302/614] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:44 2022] GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1 => generated 1723 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:18:45.211184 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-3fb821be-fc16-4df1-94e1-8da60e44166a tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:45.212513 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-3fb821be-fc16-4df1-94e1-8da60e44166a tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:45.222411 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3fb821be-fc16-4df1-94e1-8da60e44166a tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:45.222915 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3fb821be-fc16-4df1-94e1-8da60e44166a tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:45.224021 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3fb821be-fc16-4df1-94e1-8da60e44166a tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:45.224681 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3fb821be-fc16-4df1-94e1-8da60e44166a tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:45.378455 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-3fb821be-fc16-4df1-94e1-8da60e44166a tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:45.386676 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-3fb821be-fc16-4df1-94e1-8da60e44166a tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1665 microversion: 2.1 time: 0.184235 Jul 22 11:18:45.387232 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 313/615] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:45 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1665 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:18:45.527345 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-78c0e916-b942-450a-8ad3-764bf802c187 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:45.528001 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-78c0e916-b942-450a-8ad3-764bf802c187 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:45.537614 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-78c0e916-b942-450a-8ad3-764bf802c187 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:45.538435 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-78c0e916-b942-450a-8ad3-764bf802c187 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:45.540514 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-78c0e916-b942-450a-8ad3-764bf802c187 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:45.541280 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-78c0e916-b942-450a-8ad3-764bf802c187 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:45.727521 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-78c0e916-b942-450a-8ad3-764bf802c187 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:45.741242 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-78c0e916-b942-450a-8ad3-764bf802c187 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:45.743173 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-78c0e916-b942-450a-8ad3-764bf802c187 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:45.744591 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-78c0e916-b942-450a-8ad3-764bf802c187 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54" status: 200 len: 1809 microversion: 2.20 time: 0.223303 Jul 22 11:18:45.745283 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 303/616] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:18:45 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 => generated 1809 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:18:46.059061 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-9b64bc23-d5a3-4773-80e2-7c7ec6e06752 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:46.060387 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-9b64bc23-d5a3-4773-80e2-7c7ec6e06752 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 6d50352a-fd4f-4ca5-8e13-2519dfbb66a1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:46.071948 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9b64bc23-d5a3-4773-80e2-7c7ec6e06752 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:46.072886 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9b64bc23-d5a3-4773-80e2-7c7ec6e06752 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:46.074341 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9b64bc23-d5a3-4773-80e2-7c7ec6e06752 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:46.075231 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9b64bc23-d5a3-4773-80e2-7c7ec6e06752 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:46.301229 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-9b64bc23-d5a3-4773-80e2-7c7ec6e06752 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:46.310430 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-9b64bc23-d5a3-4773-80e2-7c7ec6e06752 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1" status: 200 len: 1723 microversion: 2.1 time: 0.259580 Jul 22 11:18:46.310911 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 314/617] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:46 2022] GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1 => generated 1723 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:18:46.765190 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-51225434-4a67-43fd-a17e-af9ea30267b6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:46.765994 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-51225434-4a67-43fd-a17e-af9ea30267b6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:46.772639 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-51225434-4a67-43fd-a17e-af9ea30267b6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:46.773140 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-51225434-4a67-43fd-a17e-af9ea30267b6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:46.774514 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-51225434-4a67-43fd-a17e-af9ea30267b6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:46.775021 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-51225434-4a67-43fd-a17e-af9ea30267b6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:47.091017 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-51225434-4a67-43fd-a17e-af9ea30267b6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:47.102142 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-51225434-4a67-43fd-a17e-af9ea30267b6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:47.104972 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-51225434-4a67-43fd-a17e-af9ea30267b6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:47.107122 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-51225434-4a67-43fd-a17e-af9ea30267b6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54" status: 200 len: 1809 microversion: 2.20 time: 0.347443 Jul 22 11:18:47.108149 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 304/618] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:18:46 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 => generated 1809 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:18:47.333209 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-1f09e99d-b337-4267-9fdc-c369c1c4c48f tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:47.334393 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-1f09e99d-b337-4267-9fdc-c369c1c4c48f tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 6d50352a-fd4f-4ca5-8e13-2519dfbb66a1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:47.343547 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1f09e99d-b337-4267-9fdc-c369c1c4c48f tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:47.344001 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1f09e99d-b337-4267-9fdc-c369c1c4c48f tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:47.344793 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1f09e99d-b337-4267-9fdc-c369c1c4c48f tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:47.345234 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1f09e99d-b337-4267-9fdc-c369c1c4c48f tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:47.556336 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-1f09e99d-b337-4267-9fdc-c369c1c4c48f tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:47.565523 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-1f09e99d-b337-4267-9fdc-c369c1c4c48f tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1" status: 200 len: 1723 microversion: 2.1 time: 0.239121 Jul 22 11:18:47.566109 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 315/619] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:47 2022] GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1 => generated 1723 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:18:48.132625 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-b86b08f0-539d-47d7-96e0-0e4167ad57e5 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:48.134757 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-b86b08f0-539d-47d7-96e0-0e4167ad57e5 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:48.145740 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-b86b08f0-539d-47d7-96e0-0e4167ad57e5 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:48.146464 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-b86b08f0-539d-47d7-96e0-0e4167ad57e5 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:48.147842 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-b86b08f0-539d-47d7-96e0-0e4167ad57e5 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:48.149166 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-b86b08f0-539d-47d7-96e0-0e4167ad57e5 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:48.341624 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-b86b08f0-539d-47d7-96e0-0e4167ad57e5 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:48.351044 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-b86b08f0-539d-47d7-96e0-0e4167ad57e5 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:48.352628 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-b86b08f0-539d-47d7-96e0-0e4167ad57e5 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:48.353820 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-b86b08f0-539d-47d7-96e0-0e4167ad57e5 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54" status: 200 len: 1809 microversion: 2.20 time: 0.227978 Jul 22 11:18:48.354388 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 305/620] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:18:48 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 => generated 1809 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:18:48.589900 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-5b4f827b-3297-46f2-9d17-6d51572b8f27 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:48.590627 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-5b4f827b-3297-46f2-9d17-6d51572b8f27 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 6d50352a-fd4f-4ca5-8e13-2519dfbb66a1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:48.599424 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5b4f827b-3297-46f2-9d17-6d51572b8f27 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:48.600225 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5b4f827b-3297-46f2-9d17-6d51572b8f27 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:48.601604 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5b4f827b-3297-46f2-9d17-6d51572b8f27 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:48.602385 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5b4f827b-3297-46f2-9d17-6d51572b8f27 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:48.774509 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-5b4f827b-3297-46f2-9d17-6d51572b8f27 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:48.783762 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-5b4f827b-3297-46f2-9d17-6d51572b8f27 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1" status: 200 len: 1723 microversion: 2.1 time: 0.197600 Jul 22 11:18:48.784426 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 316/621] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:48 2022] GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1 => generated 1723 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:18:49.386585 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-eac048a8-b18e-4400-aa05-78998ae22fdf tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:49.388839 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-eac048a8-b18e-4400-aa05-78998ae22fdf tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:49.397953 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-b7d5d0ca-cd8c-47d2-99c1-3d3b97c82121 req-13dccc85-bef9-4794-9d6e-93ca4d897d31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f27dab8-c005-4dd0-b262-542deb60dd54", "name": "network-vif-plugged", "status": "completed", "tag": "019d06a1-2c6e-4ebb-b1f0-a080fc8a2fef"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:18:49.412671 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-eac048a8-b18e-4400-aa05-78998ae22fdf tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:49.413548 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-eac048a8-b18e-4400-aa05-78998ae22fdf tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:49.414066 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-b7d5d0ca-cd8c-47d2-99c1-3d3b97c82121 req-13dccc85-bef9-4794-9d6e-93ca4d897d31 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:49.415480 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-b7d5d0ca-cd8c-47d2-99c1-3d3b97c82121 req-13dccc85-bef9-4794-9d6e-93ca4d897d31 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:49.415991 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-eac048a8-b18e-4400-aa05-78998ae22fdf tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:49.416894 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-eac048a8-b18e-4400-aa05-78998ae22fdf tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:49.432667 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-b7d5d0ca-cd8c-47d2-99c1-3d3b97c82121 req-13dccc85-bef9-4794-9d6e-93ca4d897d31 service nova] Creating event network-vif-plugged:019d06a1-2c6e-4ebb-b1f0-a080fc8a2fef for instance 1f27dab8-c005-4dd0-b262-542deb60dd54 on hv-cinder-84890 Jul 22 11:18:49.442247 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-b7d5d0ca-cd8c-47d2-99c1-3d3b97c82121 req-13dccc85-bef9-4794-9d6e-93ca4d897d31 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050694 Jul 22 11:18:49.444271 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 317/622] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:18:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:18:49.609340 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-eac048a8-b18e-4400-aa05-78998ae22fdf tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:49.618407 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-eac048a8-b18e-4400-aa05-78998ae22fdf tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:49.620010 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-eac048a8-b18e-4400-aa05-78998ae22fdf tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:49.621158 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-eac048a8-b18e-4400-aa05-78998ae22fdf tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54" status: 200 len: 1809 microversion: 2.20 time: 0.242955 Jul 22 11:18:49.621728 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 306/623] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:18:49 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 => generated 1809 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:18:49.807924 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-ac502553-3108-4797-abce-4030d9e37bf5 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:49.808790 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-ac502553-3108-4797-abce-4030d9e37bf5 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 6d50352a-fd4f-4ca5-8e13-2519dfbb66a1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:49.815247 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ac502553-3108-4797-abce-4030d9e37bf5 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:49.815736 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ac502553-3108-4797-abce-4030d9e37bf5 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:49.816645 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ac502553-3108-4797-abce-4030d9e37bf5 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:49.817088 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ac502553-3108-4797-abce-4030d9e37bf5 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:50.000401 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-ac502553-3108-4797-abce-4030d9e37bf5 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:50.014575 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-ac502553-3108-4797-abce-4030d9e37bf5 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1" status: 200 len: 1729 microversion: 2.1 time: 0.211680 Jul 22 11:18:50.015623 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 318/624] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:18:49 2022] GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1 => generated 1729 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:18:50.036968 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-508035fe-75da-49c8-b96f-c9bab537f95c tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:50.037455 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-508035fe-75da-49c8-b96f-c9bab537f95c tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 6d50352a-fd4f-4ca5-8e13-2519dfbb66a1] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:50.043580 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-508035fe-75da-49c8-b96f-c9bab537f95c tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:50.044202 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-508035fe-75da-49c8-b96f-c9bab537f95c tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:50.044797 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-508035fe-75da-49c8-b96f-c9bab537f95c tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:50.045223 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-508035fe-75da-49c8-b96f-c9bab537f95c tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:50.148015 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-508035fe-75da-49c8-b96f-c9bab537f95c tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.114853 Jul 22 11:18:50.148597 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 307/625] 10.222.0.20 () {58 vars in 1274 bytes} [Fri Jul 22 11:18:50 2022] GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1/os-interface => generated 284 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 22 11:18:50.643612 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-04e6a4e8-8b69-4cfb-a263-ae34a26dfc7c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:50.644615 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-04e6a4e8-8b69-4cfb-a263-ae34a26dfc7c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:50.660332 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-04e6a4e8-8b69-4cfb-a263-ae34a26dfc7c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:50.660332 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-04e6a4e8-8b69-4cfb-a263-ae34a26dfc7c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:50.660834 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-04e6a4e8-8b69-4cfb-a263-ae34a26dfc7c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:50.661219 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-04e6a4e8-8b69-4cfb-a263-ae34a26dfc7c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:50.848384 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-04e6a4e8-8b69-4cfb-a263-ae34a26dfc7c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:50.860655 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-04e6a4e8-8b69-4cfb-a263-ae34a26dfc7c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:50.862191 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-04e6a4e8-8b69-4cfb-a263-ae34a26dfc7c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:50.863447 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-04e6a4e8-8b69-4cfb-a263-ae34a26dfc7c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54" status: 200 len: 1809 microversion: 2.20 time: 0.225940 Jul 22 11:18:50.864027 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 319/626] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:18:50 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 => generated 1809 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:18:51.620549 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [req-d628dfea-a4e3-4e82-ab56-5b804da1b4b8 req-c3715562-fbb0-4d14-9b12-7a20f867d61a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d50352a-fd4f-4ca5-8e13-2519dfbb66a1", "tag": "fa52f10e-8382-40d6-8633-f6bcf76980e8"}]} {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:18:51.630784 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-d628dfea-a4e3-4e82-ab56-5b804da1b4b8 req-c3715562-fbb0-4d14-9b12-7a20f867d61a service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:51.631222 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-d628dfea-a4e3-4e82-ab56-5b804da1b4b8 req-c3715562-fbb0-4d14-9b12-7a20f867d61a service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:51.644896 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.compute.server_external_events [req-d628dfea-a4e3-4e82-ab56-5b804da1b4b8 req-c3715562-fbb0-4d14-9b12-7a20f867d61a service nova] Creating event network-changed:fa52f10e-8382-40d6-8633-f6bcf76980e8 for instance 6d50352a-fd4f-4ca5-8e13-2519dfbb66a1 on hv-cinder-84890 Jul 22 11:18:51.651279 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [req-d628dfea-a4e3-4e82-ab56-5b804da1b4b8 req-c3715562-fbb0-4d14-9b12-7a20f867d61a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039075 Jul 22 11:18:51.652117 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 308/627] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:18:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:18:51.894646 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-6fc554a7-9f45-43a1-b9a6-c0d43abed291 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:51.895363 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-6fc554a7-9f45-43a1-b9a6-c0d43abed291 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:51.904268 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6fc554a7-9f45-43a1-b9a6-c0d43abed291 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:51.904883 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6fc554a7-9f45-43a1-b9a6-c0d43abed291 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:51.905794 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6fc554a7-9f45-43a1-b9a6-c0d43abed291 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:51.906243 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6fc554a7-9f45-43a1-b9a6-c0d43abed291 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:52.089638 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-6fc554a7-9f45-43a1-b9a6-c0d43abed291 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:52.104747 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-6fc554a7-9f45-43a1-b9a6-c0d43abed291 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:52.107527 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-6fc554a7-9f45-43a1-b9a6-c0d43abed291 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:52.109502 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-6fc554a7-9f45-43a1-b9a6-c0d43abed291 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54" status: 200 len: 1809 microversion: 2.20 time: 0.220830 Jul 22 11:18:52.110425 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 320/628] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:18:51 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 => generated 1809 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:18:53.136225 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-5390e01f-b70e-4b04-8c50-b8b7396ad34b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:53.143952 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-5390e01f-b70e-4b04-8c50-b8b7396ad34b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:53.145514 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-5390e01f-b70e-4b04-8c50-b8b7396ad34b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:53.146028 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-5390e01f-b70e-4b04-8c50-b8b7396ad34b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:53.146959 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-5390e01f-b70e-4b04-8c50-b8b7396ad34b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:53.147522 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-5390e01f-b70e-4b04-8c50-b8b7396ad34b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:53.350369 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-5390e01f-b70e-4b04-8c50-b8b7396ad34b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:53.366617 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-5390e01f-b70e-4b04-8c50-b8b7396ad34b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:53.369484 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-5390e01f-b70e-4b04-8c50-b8b7396ad34b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:53.371665 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-5390e01f-b70e-4b04-8c50-b8b7396ad34b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54" status: 200 len: 1809 microversion: 2.20 time: 0.244415 Jul 22 11:18:53.373796 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 309/629] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:18:53 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 => generated 1809 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:18:53.672785 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-638faa6d-9067-486c-8dbc-81031ec287f0 req-e6951020-9825-4137-90f8-6b6994c2f415 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d50352a-fd4f-4ca5-8e13-2519dfbb66a1", "tag": "fa52f10e-8382-40d6-8633-f6bcf76980e8"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:18:53.682068 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-638faa6d-9067-486c-8dbc-81031ec287f0 req-e6951020-9825-4137-90f8-6b6994c2f415 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:53.682538 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-638faa6d-9067-486c-8dbc-81031ec287f0 req-e6951020-9825-4137-90f8-6b6994c2f415 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:53.695236 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-638faa6d-9067-486c-8dbc-81031ec287f0 req-e6951020-9825-4137-90f8-6b6994c2f415 service nova] Creating event network-changed:fa52f10e-8382-40d6-8633-f6bcf76980e8 for instance 6d50352a-fd4f-4ca5-8e13-2519dfbb66a1 on hv-cinder-84890 Jul 22 11:18:53.701425 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-638faa6d-9067-486c-8dbc-81031ec287f0 req-e6951020-9825-4137-90f8-6b6994c2f415 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033200 Jul 22 11:18:53.702167 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 321/630] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:18:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:18:54.397604 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-a40c758e-076f-426e-88ed-e506c8d44bc6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:18:54.398198 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-a40c758e-076f-426e-88ed-e506c8d44bc6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:18:54.404763 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-a40c758e-076f-426e-88ed-e506c8d44bc6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:54.405206 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-a40c758e-076f-426e-88ed-e506c8d44bc6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:54.405976 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-a40c758e-076f-426e-88ed-e506c8d44bc6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:18:54.406406 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-a40c758e-076f-426e-88ed-e506c8d44bc6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:18:54.552530 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-a40c758e-076f-426e-88ed-e506c8d44bc6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:54.562666 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-a40c758e-076f-426e-88ed-e506c8d44bc6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:54.564206 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-a40c758e-076f-426e-88ed-e506c8d44bc6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:18:54.565377 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-a40c758e-076f-426e-88ed-e506c8d44bc6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54" status: 200 len: 1796 microversion: 2.20 time: 0.171750 Jul 22 11:18:54.565942 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 310/631] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:18:54 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 => generated 1796 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:19:05.464878 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 22 11:19:05.465481 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Fri Jul 22 11:19:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 22 11:19:25.031508 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_api:SELECT=31 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:19:25.032355 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:19:25.037084 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-4d805399-309d-40a4-bd39-34b9a0cc1664 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1723185665"}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:19:25.037773 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-4d805399-309d-40a4-bd39-34b9a0cc1664 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] [instance: 39fe8666-e4cc-464c-9af9-bd43835bccf6] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:25.047017 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4d805399-309d-40a4-bd39-34b9a0cc1664 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:25.047494 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4d805399-309d-40a4-bd39-34b9a0cc1664 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:25.048278 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4d805399-309d-40a4-bd39-34b9a0cc1664 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:25.048712 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4d805399-309d-40a4-bd39-34b9a0cc1664 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:25.269220 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.network.security_group_api [None req-4d805399-309d-40a4-bd39-34b9a0cc1664 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Removing security group 80829b56-b05b-46bf-8e3c-cc68252d7c0b from port 2dfea6d8-ff88-4cd2-885a-008177cdfd33 Jul 22 11:19:25.675761 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-4d805399-309d-40a4-bd39-34b9a0cc1664 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] 10.222.0.20 "POST /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6/action" status: 202 len: 0 microversion: 2.1 time: 0.645210 Jul 22 11:19:25.687979 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 322/632] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Jul 22 11:19:25 2022] POST /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6/action => generated 0 bytes in 659 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 22 11:19:25.690933 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG dbcounter [-] [117884] Writing DB stats nova_api:SELECT=27 {{(pid=117884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:19:25.691687 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG dbcounter [-] [117884] Writing DB stats nova_cell1:SELECT=82 {{(pid=117884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:19:25.826576 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [req-c5414124-296a-402b-b2e1-39244510239d req-5d2bff3f-5d01-47dc-9378-a468fed0fe3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39fe8666-e4cc-464c-9af9-bd43835bccf6", "tag": "2dfea6d8-ff88-4cd2-885a-008177cdfd33"}]} {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:19:25.838892 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-c5414124-296a-402b-b2e1-39244510239d req-5d2bff3f-5d01-47dc-9378-a468fed0fe3e service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:25.839367 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-c5414124-296a-402b-b2e1-39244510239d req-5d2bff3f-5d01-47dc-9378-a468fed0fe3e service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:25.861383 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.compute.server_external_events [req-c5414124-296a-402b-b2e1-39244510239d req-5d2bff3f-5d01-47dc-9378-a468fed0fe3e service nova] Creating event network-changed:2dfea6d8-ff88-4cd2-885a-008177cdfd33 for instance 39fe8666-e4cc-464c-9af9-bd43835bccf6 on hv-cinder-84890 Jul 22 11:19:25.873286 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [req-c5414124-296a-402b-b2e1-39244510239d req-5d2bff3f-5d01-47dc-9378-a468fed0fe3e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.186746 Jul 22 11:19:25.880910 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 311/633] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:19:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:19:27.069015 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-e9311ac3-9f40-49c6-81b3-282b8068be98 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:27.069745 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-e9311ac3-9f40-49c6-81b3-282b8068be98 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] [instance: 39fe8666-e4cc-464c-9af9-bd43835bccf6] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:27.076017 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e9311ac3-9f40-49c6-81b3-282b8068be98 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:27.076490 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e9311ac3-9f40-49c6-81b3-282b8068be98 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:27.077266 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e9311ac3-9f40-49c6-81b3-282b8068be98 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:27.077693 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e9311ac3-9f40-49c6-81b3-282b8068be98 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:27.255354 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.objects.instance [None req-e9311ac3-9f40-49c6-81b3-282b8068be98 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lazy-loading 'services' on Instance uuid 39fe8666-e4cc-464c-9af9-bd43835bccf6 {{(pid=117885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 22 11:19:27.392416 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-e9311ac3-9f40-49c6-81b3-282b8068be98 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] 10.222.0.20 "DELETE /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6/os-volume_attachments/7333057c-1797-468b-9675-2d22a5216d07" status: 202 len: 0 microversion: 2.1 time: 0.327896 Jul 22 11:19:27.393020 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 323/634] 10.222.0.20 () {58 vars in 1415 bytes} [Fri Jul 22 11:19:27 2022] DELETE /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6/os-volume_attachments/7333057c-1797-468b-9675-2d22a5216d07 => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 22 11:19:27.403494 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-ccac221b-c1b5-42c8-b005-b7e17f68eb04 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:27.405140 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-ccac221b-c1b5-42c8-b005-b7e17f68eb04 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] [instance: 39fe8666-e4cc-464c-9af9-bd43835bccf6] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:27.415705 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-ccac221b-c1b5-42c8-b005-b7e17f68eb04 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:27.416521 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-ccac221b-c1b5-42c8-b005-b7e17f68eb04 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:27.417490 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-ccac221b-c1b5-42c8-b005-b7e17f68eb04 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:27.418231 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-ccac221b-c1b5-42c8-b005-b7e17f68eb04 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:27.457024 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-ccac221b-c1b5-42c8-b005-b7e17f68eb04 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] 10.222.0.20 "GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058610 Jul 22 11:19:27.458905 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 312/635] 10.222.0.20 () {58 vars in 1301 bytes} [Fri Jul 22 11:19:27 2022] GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 22 11:19:27.894723 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-86792399-7064-41bd-8ba9-10be8a52373d req-f1095eac-033b-4b00-9e51-94b60e8cbfcd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39fe8666-e4cc-464c-9af9-bd43835bccf6", "tag": "2dfea6d8-ff88-4cd2-885a-008177cdfd33"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:19:27.905171 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-86792399-7064-41bd-8ba9-10be8a52373d req-f1095eac-033b-4b00-9e51-94b60e8cbfcd service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:27.905699 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-86792399-7064-41bd-8ba9-10be8a52373d req-f1095eac-033b-4b00-9e51-94b60e8cbfcd service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:27.918355 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-86792399-7064-41bd-8ba9-10be8a52373d req-f1095eac-033b-4b00-9e51-94b60e8cbfcd service nova] Creating event network-changed:2dfea6d8-ff88-4cd2-885a-008177cdfd33 for instance 39fe8666-e4cc-464c-9af9-bd43835bccf6 on hv-cinder-84890 Jul 22 11:19:27.923917 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-86792399-7064-41bd-8ba9-10be8a52373d req-f1095eac-033b-4b00-9e51-94b60e8cbfcd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034747 Jul 22 11:19:27.924517 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 324/636] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:19:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 22 11:19:28.480425 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-fa79445e-e01f-4d87-944d-bba2604f3d0a tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:28.482187 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-fa79445e-e01f-4d87-944d-bba2604f3d0a tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] [instance: 39fe8666-e4cc-464c-9af9-bd43835bccf6] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:28.496066 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-fa79445e-e01f-4d87-944d-bba2604f3d0a tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:28.496872 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-fa79445e-e01f-4d87-944d-bba2604f3d0a tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:28.498400 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-fa79445e-e01f-4d87-944d-bba2604f3d0a tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:28.499192 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-fa79445e-e01f-4d87-944d-bba2604f3d0a tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:28.562222 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-fa79445e-e01f-4d87-944d-bba2604f3d0a tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] 10.222.0.20 "GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090394 Jul 22 11:19:28.563126 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 313/637] 10.222.0.20 () {58 vars in 1301 bytes} [Fri Jul 22 11:19:28 2022] GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:19:29.581305 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-1763f6f8-eb9f-43da-b72a-1ab25ca2b777 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:29.582793 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-1763f6f8-eb9f-43da-b72a-1ab25ca2b777 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] [instance: 39fe8666-e4cc-464c-9af9-bd43835bccf6] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:29.592335 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1763f6f8-eb9f-43da-b72a-1ab25ca2b777 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:29.592969 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1763f6f8-eb9f-43da-b72a-1ab25ca2b777 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:29.594125 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1763f6f8-eb9f-43da-b72a-1ab25ca2b777 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:29.594742 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1763f6f8-eb9f-43da-b72a-1ab25ca2b777 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:29.636505 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-1763f6f8-eb9f-43da-b72a-1ab25ca2b777 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] 10.222.0.20 "GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.063069 Jul 22 11:19:29.637098 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 325/638] 10.222.0.20 () {58 vars in 1301 bytes} [Fri Jul 22 11:19:29 2022] GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 22 11:19:29.647289 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-a382cb3a-1a0f-41b9-ba0f-48395b932acb tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:29.648503 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-a382cb3a-1a0f-41b9-ba0f-48395b932acb tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] [instance: 39fe8666-e4cc-464c-9af9-bd43835bccf6] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:29.656867 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-a382cb3a-1a0f-41b9-ba0f-48395b932acb tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:29.657341 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-a382cb3a-1a0f-41b9-ba0f-48395b932acb tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:29.658110 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-a382cb3a-1a0f-41b9-ba0f-48395b932acb tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:29.658569 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-a382cb3a-1a0f-41b9-ba0f-48395b932acb tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:29.853808 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.wsgi [None req-a382cb3a-1a0f-41b9-ba0f-48395b932acb tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] HTTP exception thrown: Instance 39fe8666-e4cc-464c-9af9-bd43835bccf6 is not attached to volume 7333057c-1797-468b-9675-2d22a5216d07 Jul 22 11:19:29.858054 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-a382cb3a-1a0f-41b9-ba0f-48395b932acb tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Request method failure captured: Jul 22 11:19:29.858054 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: request: DELETE /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6/os-volume_attachments/7333057c-1797-468b-9675-2d22a5216d07 HTTP/1.1 Jul 22 11:19:29.858054 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Accept: application/json Jul 22 11:19:29.858054 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Accept-Encoding: identity Jul 22 11:19:29.858054 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Connection: close Jul 22 11:19:29.858054 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Content-Length: 0 Jul 22 11:19:29.858054 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Content-Type: application/json Jul 22 11:19:29.858054 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Host: 10.222.0.20 Jul 22 11:19:29.858054 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Openstack-System-Scope: None Jul 22 11:19:29.858054 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: User-Agent: python-urllib3/1.26.9 Jul 22 11:19:29.858054 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Auth-Token: gAAAAABi2obRTKoDvbTtlJ-MjQVjFfg3n9mx67zwsPSgkjZq80P8x861li8frsT586ETZ3WY0NISC7omQZ83tel7IFoEOoAh_uot6w0nqz3xGQcM5vFrNDrQiZQ0e5cu8s1_n1ds25rYlp_XptCLTFxfkA2dDzMT-P-KEk9ean9Ma3PKr8PnbO0 Jul 22 11:19:29.858054 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Domain-Id: None Jul 22 11:19:29.858054 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Domain-Name: None Jul 22 11:19:29.858054 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Identity-Status: Confirmed Jul 22 11:19:29.858054 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Is-Admin-Project: True Jul 22 11:19:29.858054 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Domain-Id: default Jul 22 11:19:29.858054 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Domain-Name: Default Jul 22 11:19:29.858054 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Id: a84fa2f397c54be1b409d8be5ebc8491 Jul 22 11:19:29.858054 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Name: tempest-TestMinimumBasicScenario-1887984995 Jul 22 11:19:29.858054 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Role: reader,member Jul 22 11:19:29.858054 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Roles: reader,member Jul 22 11:19:29.859789 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a84fa2f397c54be1b409d8be5ebc8491"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a84fa2f397c54be1b409d8be5ebc8491", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a84fa2f397c54be1b409d8be5ebc8491"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a84fa2f397c54be1b409d8be5ebc8491"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jul 22 11:19:29.859789 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant: tempest-TestMinimumBasicScenario-1887984995 Jul 22 11:19:29.859789 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant-Id: a84fa2f397c54be1b409d8be5ebc8491 Jul 22 11:19:29.859789 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1887984995 Jul 22 11:19:29.859789 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User: tempest-TestMinimumBasicScenario-1887984995-project Jul 22 11:19:29.859789 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Domain-Id: default Jul 22 11:19:29.859789 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Domain-Name: Default Jul 22 11:19:29.859789 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Id: e908d2b09dfc4a139d9c27f52580e15b Jul 22 11:19:29.859789 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Name: tempest-TestMinimumBasicScenario-1887984995-project Jul 22 11:19:29.859789 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: method: > Jul 22 11:19:29.859789 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: exception: Instance 39fe8666-e4cc-464c-9af9-bd43835bccf6 is not attached to volume 7333057c-1797-468b-9675-2d22a5216d07 Jul 22 11:19:29.860674 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: action_args: {'server_id': '39fe8666-e4cc-464c-9af9-bd43835bccf6', 'id': '7333057c-1797-468b-9675-2d22a5216d07'} Jul 22 11:19:29.860674 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 22 11:19:29.860674 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:19:29.860674 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 22 11:19:29.860674 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 22 11:19:29.860674 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 22 11:19:29.860674 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 22 11:19:29.860674 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 22 11:19:29.860674 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 22 11:19:29.860674 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 7333057c-1797-468b-9675-2d22a5216d07. Jul 22 11:19:29.860674 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:19:29.860674 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:19:29.860674 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:19:29.860674 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:19:29.860674 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:19:29.860674 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:19:29.860674 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 22 11:19:29.860674 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 22 11:19:29.860674 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 22 11:19:29.862036 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 22 11:19:29.862036 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 22 11:19:29.862036 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 22 11:19:29.862036 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39fe8666-e4cc-464c-9af9-bd43835bccf6 is not attached to volume 7333057c-1797-468b-9675-2d22a5216d07 Jul 22 11:19:29.862036 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:19:29.862036 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:19:29.862036 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:19:29.862036 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:19:29.862036 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:19:29.862036 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:19:29.862036 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 22 11:19:29.862036 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 22 11:19:29.862036 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39fe8666-e4cc-464c-9af9-bd43835bccf6 is not attached to volume 7333057c-1797-468b-9675-2d22a5216d07 Jul 22 11:19:29.862036 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:19:29.862036 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-a382cb3a-1a0f-41b9-ba0f-48395b932acb tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Returning 404 to user: Instance 39fe8666-e4cc-464c-9af9-bd43835bccf6 is not attached to volume 7333057c-1797-468b-9675-2d22a5216d07 {{(pid=117884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 22 11:19:29.862991 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-a382cb3a-1a0f-41b9-ba0f-48395b932acb tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] 10.222.0.20 "DELETE /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6/os-volume_attachments/7333057c-1797-468b-9675-2d22a5216d07" status: 404 len: 154 microversion: 2.1 time: 0.217135 Jul 22 11:19:29.862991 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 314/639] 10.222.0.20 () {58 vars in 1415 bytes} [Fri Jul 22 11:19:29 2022] DELETE /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6/os-volume_attachments/7333057c-1797-468b-9675-2d22a5216d07 => generated 154 bytes in 219 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 22 11:19:31.016570 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-8024dad2-2176-42ae-80b0-768567a91cac tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:31.017227 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-8024dad2-2176-42ae-80b0-768567a91cac tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] [instance: 39fe8666-e4cc-464c-9af9-bd43835bccf6] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:31.024692 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8024dad2-2176-42ae-80b0-768567a91cac tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:31.025156 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8024dad2-2176-42ae-80b0-768567a91cac tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:31.025932 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8024dad2-2176-42ae-80b0-768567a91cac tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:31.026362 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8024dad2-2176-42ae-80b0-768567a91cac tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:31.065250 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-8024dad2-2176-42ae-80b0-768567a91cac tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] [instance: 39fe8666-e4cc-464c-9af9-bd43835bccf6] Going to try to terminate instance {{(pid=117885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 22 11:19:31.081056 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-6abe52e1-56ea-4383-be4f-444380ad0efe tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:31.082319 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-6abe52e1-56ea-4383-be4f-444380ad0efe tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:31.092205 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-6abe52e1-56ea-4383-be4f-444380ad0efe tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:31.092668 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-6abe52e1-56ea-4383-be4f-444380ad0efe tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:31.093556 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-6abe52e1-56ea-4383-be4f-444380ad0efe tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:31.093991 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-6abe52e1-56ea-4383-be4f-444380ad0efe tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:31.129342 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-6abe52e1-56ea-4383-be4f-444380ad0efe tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054082 Jul 22 11:19:31.130006 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 315/640] 10.222.0.20 () {58 vars in 1301 bytes} [Fri Jul 22 11:19:31 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 22 11:19:31.178819 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-8024dad2-2176-42ae-80b0-768567a91cac tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] 10.222.0.20 "DELETE /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6" status: 204 len: 0 microversion: 2.1 time: 0.165218 Jul 22 11:19:31.179442 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 326/641] 10.222.0.20 () {58 vars in 1238 bytes} [Fri Jul 22 11:19:31 2022] DELETE /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 22 11:19:31.194513 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-6bb4a825-12b1-4d28-b8af-03c336f40175 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:31.195870 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-6bb4a825-12b1-4d28-b8af-03c336f40175 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] [instance: 39fe8666-e4cc-464c-9af9-bd43835bccf6] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:31.205939 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-fcb298cc-a4fc-4026-a295-c148134204d5 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:31.206556 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-6bb4a825-12b1-4d28-b8af-03c336f40175 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:31.206705 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-fcb298cc-a4fc-4026-a295-c148134204d5 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:31.207418 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-6bb4a825-12b1-4d28-b8af-03c336f40175 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:31.208803 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-6bb4a825-12b1-4d28-b8af-03c336f40175 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:31.209715 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-6bb4a825-12b1-4d28-b8af-03c336f40175 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:31.215475 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fcb298cc-a4fc-4026-a295-c148134204d5 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:31.216243 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fcb298cc-a4fc-4026-a295-c148134204d5 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:31.217375 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fcb298cc-a4fc-4026-a295-c148134204d5 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:31.217844 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fcb298cc-a4fc-4026-a295-c148134204d5 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:31.253687 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-fcb298cc-a4fc-4026-a295-c148134204d5 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Going to try to terminate instance {{(pid=117885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 22 11:19:31.359351 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-fcb298cc-a4fc-4026-a295-c148134204d5 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 204 len: 0 microversion: 2.1 time: 0.157395 Jul 22 11:19:31.359997 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 327/642] 10.222.0.20 () {58 vars in 1238 bytes} [Fri Jul 22 11:19:31 2022] DELETE /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 22 11:19:31.370072 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-8a64d58e-f35d-456c-aa11-0071c8f9e675 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:31.370779 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-8a64d58e-f35d-456c-aa11-0071c8f9e675 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:31.374538 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-6bb4a825-12b1-4d28-b8af-03c336f40175 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e908d2b09dfc4a139d9c27f52580e15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84fa2f397c54be1b409d8be5ebc8491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:19:31.377433 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8a64d58e-f35d-456c-aa11-0071c8f9e675 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:31.377908 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8a64d58e-f35d-456c-aa11-0071c8f9e675 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:31.378956 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8a64d58e-f35d-456c-aa11-0071c8f9e675 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:31.380014 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8a64d58e-f35d-456c-aa11-0071c8f9e675 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:31.385821 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-6bb4a825-12b1-4d28-b8af-03c336f40175 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] 10.222.0.20 "GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6" status: 200 len: 1553 microversion: 2.1 time: 0.200819 Jul 22 11:19:31.386621 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 316/643] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:19:31 2022] GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6 => generated 1553 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:19:31.548355 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-8a64d58e-f35d-456c-aa11-0071c8f9e675 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:19:31.557350 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-8a64d58e-f35d-456c-aa11-0071c8f9e675 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1671 microversion: 2.1 time: 0.191980 Jul 22 11:19:31.558263 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 328/644] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:19:31 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1671 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:19:32.026088 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-b52ff4c9-11bd-4475-8365-5dc79d96b2aa tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:32.026592 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-b52ff4c9-11bd-4475-8365-5dc79d96b2aa tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 272976bd-b870-41a6-9bcd-598e1c9d34bc] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:32.035578 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-b52ff4c9-11bd-4475-8365-5dc79d96b2aa tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:32.036022 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-b52ff4c9-11bd-4475-8365-5dc79d96b2aa tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:32.036807 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-b52ff4c9-11bd-4475-8365-5dc79d96b2aa tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:32.037239 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-b52ff4c9-11bd-4475-8365-5dc79d96b2aa tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:32.066493 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-b52ff4c9-11bd-4475-8365-5dc79d96b2aa tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/272976bd-b870-41a6-9bcd-598e1c9d34bc/ips" status: 200 len: 149 microversion: 2.1 time: 0.115678 Jul 22 11:19:32.067067 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 317/645] 10.222.0.20 () {58 vars in 1247 bytes} [Fri Jul 22 11:19:31 2022] GET /compute/v2.1/servers/272976bd-b870-41a6-9bcd-598e1c9d34bc/ips => generated 149 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:19:32.404079 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-578e98d8-fb28-4229-9486-106572cb5484 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:32.404696 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-578e98d8-fb28-4229-9486-106572cb5484 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] [instance: 39fe8666-e4cc-464c-9af9-bd43835bccf6] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:32.415647 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-578e98d8-fb28-4229-9486-106572cb5484 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:32.416653 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-578e98d8-fb28-4229-9486-106572cb5484 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:32.421657 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-578e98d8-fb28-4229-9486-106572cb5484 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:32.422547 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-578e98d8-fb28-4229-9486-106572cb5484 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:32.577035 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-03608b1b-42e5-4b15-97b2-6d2609cbab5d tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:32.577874 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-03608b1b-42e5-4b15-97b2-6d2609cbab5d tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:32.590596 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-03608b1b-42e5-4b15-97b2-6d2609cbab5d tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:32.591395 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-03608b1b-42e5-4b15-97b2-6d2609cbab5d tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:32.592805 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-03608b1b-42e5-4b15-97b2-6d2609cbab5d tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:32.593523 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-03608b1b-42e5-4b15-97b2-6d2609cbab5d tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:32.617486 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-578e98d8-fb28-4229-9486-106572cb5484 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e908d2b09dfc4a139d9c27f52580e15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84fa2f397c54be1b409d8be5ebc8491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:19:32.635164 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-578e98d8-fb28-4229-9486-106572cb5484 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] 10.222.0.20 "GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6" status: 200 len: 1553 microversion: 2.1 time: 0.234916 Jul 22 11:19:32.636659 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 329/646] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:19:32 2022] GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6 => generated 1553 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:19:32.761902 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-e39d28b7-7b15-49f3-bf0e-11fb1c459c73 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:32.762773 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-e39d28b7-7b15-49f3-bf0e-11fb1c459c73 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 6d50352a-fd4f-4ca5-8e13-2519dfbb66a1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:32.765585 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-03608b1b-42e5-4b15-97b2-6d2609cbab5d tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:19:32.773168 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e39d28b7-7b15-49f3-bf0e-11fb1c459c73 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:32.773836 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e39d28b7-7b15-49f3-bf0e-11fb1c459c73 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:32.774197 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-03608b1b-42e5-4b15-97b2-6d2609cbab5d tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1671 microversion: 2.1 time: 0.201080 Jul 22 11:19:32.774795 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 318/647] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:19:32 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1671 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:19:32.775010 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e39d28b7-7b15-49f3-bf0e-11fb1c459c73 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:32.775672 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e39d28b7-7b15-49f3-bf0e-11fb1c459c73 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:32.893123 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.objects.instance [None req-e39d28b7-7b15-49f3-bf0e-11fb1c459c73 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lazy-loading 'services' on Instance uuid 6d50352a-fd4f-4ca5-8e13-2519dfbb66a1 {{(pid=117885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 22 11:19:32.983444 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-e39d28b7-7b15-49f3-bf0e-11fb1c459c73 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1/os-volume_attachments/97e32901-9964-4317-840e-1d0bc7be9091" status: 202 len: 0 microversion: 2.1 time: 0.228708 Jul 22 11:19:32.984043 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 330/648] 10.222.0.20 () {58 vars in 1415 bytes} [Fri Jul 22 11:19:32 2022] DELETE /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1/os-volume_attachments/97e32901-9964-4317-840e-1d0bc7be9091 => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 22 11:19:32.995045 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-b6f38ef8-fcd6-44c2-9a5a-b5f959a22579 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:32.996204 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-b6f38ef8-fcd6-44c2-9a5a-b5f959a22579 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 6d50352a-fd4f-4ca5-8e13-2519dfbb66a1] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:33.005380 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-b6f38ef8-fcd6-44c2-9a5a-b5f959a22579 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:33.006638 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-b6f38ef8-fcd6-44c2-9a5a-b5f959a22579 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:33.008045 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-b6f38ef8-fcd6-44c2-9a5a-b5f959a22579 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:33.008815 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-b6f38ef8-fcd6-44c2-9a5a-b5f959a22579 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:33.043665 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-b6f38ef8-fcd6-44c2-9a5a-b5f959a22579 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052819 Jul 22 11:19:33.044239 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 319/649] 10.222.0.20 () {58 vars in 1301 bytes} [Fri Jul 22 11:19:32 2022] GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:19:33.476830 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-355d77e8-4759-4ea1-8b0a-f1ab022631b3 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ad33c2ab-3366-4c02-b53b-7c6f2f789506"}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:19:33.478131 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-355d77e8-4759-4ea1-8b0a-f1ab022631b3 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 272976bd-b870-41a6-9bcd-598e1c9d34bc] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:33.487174 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-355d77e8-4759-4ea1-8b0a-f1ab022631b3 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:33.487733 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-355d77e8-4759-4ea1-8b0a-f1ab022631b3 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:33.488569 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-355d77e8-4759-4ea1-8b0a-f1ab022631b3 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:33.489039 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-355d77e8-4759-4ea1-8b0a-f1ab022631b3 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:33.658197 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-080b1dfd-40d5-4f32-9bed-ea6f5f41aa5e tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:33.658882 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-080b1dfd-40d5-4f32-9bed-ea6f5f41aa5e tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] [instance: 39fe8666-e4cc-464c-9af9-bd43835bccf6] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:33.666328 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-080b1dfd-40d5-4f32-9bed-ea6f5f41aa5e tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:33.666777 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-080b1dfd-40d5-4f32-9bed-ea6f5f41aa5e tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:33.667601 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-080b1dfd-40d5-4f32-9bed-ea6f5f41aa5e tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:33.668041 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-080b1dfd-40d5-4f32-9bed-ea6f5f41aa5e tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:33.827982 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-080b1dfd-40d5-4f32-9bed-ea6f5f41aa5e tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e908d2b09dfc4a139d9c27f52580e15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84fa2f397c54be1b409d8be5ebc8491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:19:33.837866 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-080b1dfd-40d5-4f32-9bed-ea6f5f41aa5e tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] 10.222.0.20 "GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6" status: 200 len: 1553 microversion: 2.1 time: 0.183547 Jul 22 11:19:33.838458 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 320/650] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:19:33 2022] GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6 => generated 1553 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:19:33.843131 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-55a14a56-8866-4d8f-a724-37ec0c435343 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:33.843766 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-55a14a56-8866-4d8f-a724-37ec0c435343 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:33.850525 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-55a14a56-8866-4d8f-a724-37ec0c435343 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:33.851003 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-55a14a56-8866-4d8f-a724-37ec0c435343 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:33.851837 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-55a14a56-8866-4d8f-a724-37ec0c435343 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:33.852323 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-55a14a56-8866-4d8f-a724-37ec0c435343 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:33.995696 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-55a14a56-8866-4d8f-a724-37ec0c435343 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:19:34.004043 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-55a14a56-8866-4d8f-a724-37ec0c435343 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1671 microversion: 2.1 time: 0.164469 Jul 22 11:19:34.004640 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 321/651] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:19:33 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1671 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:19:34.057892 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-126ad22c-3322-4cd7-a1e1-b92b2cc4da5c tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:34.058851 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-126ad22c-3322-4cd7-a1e1-b92b2cc4da5c tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 6d50352a-fd4f-4ca5-8e13-2519dfbb66a1] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:34.067875 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-126ad22c-3322-4cd7-a1e1-b92b2cc4da5c tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:34.068364 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-126ad22c-3322-4cd7-a1e1-b92b2cc4da5c tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:34.069152 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-126ad22c-3322-4cd7-a1e1-b92b2cc4da5c tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:34.069587 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-126ad22c-3322-4cd7-a1e1-b92b2cc4da5c tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:34.106599 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-126ad22c-3322-4cd7-a1e1-b92b2cc4da5c tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052462 Jul 22 11:19:34.107241 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 322/652] 10.222.0.20 () {58 vars in 1301 bytes} [Fri Jul 22 11:19:34 2022] GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 22 11:19:34.858450 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-9fe501da-4d95-489e-b17c-d9b6708105f7 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:34.859530 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-9fe501da-4d95-489e-b17c-d9b6708105f7 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] [instance: 39fe8666-e4cc-464c-9af9-bd43835bccf6] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:34.868165 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-9fe501da-4d95-489e-b17c-d9b6708105f7 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:34.868615 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-9fe501da-4d95-489e-b17c-d9b6708105f7 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:34.869398 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-9fe501da-4d95-489e-b17c-d9b6708105f7 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:34.869824 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-9fe501da-4d95-489e-b17c-d9b6708105f7 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:35.023370 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-9fe501da-4d95-489e-b17c-d9b6708105f7 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e908d2b09dfc4a139d9c27f52580e15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84fa2f397c54be1b409d8be5ebc8491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:19:35.031320 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-9fe501da-4d95-489e-b17c-d9b6708105f7 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] 10.222.0.20 "GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6" status: 200 len: 1553 microversion: 2.1 time: 0.178986 Jul 22 11:19:35.031909 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 323/653] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:19:34 2022] GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6 => generated 1553 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:19:35.036420 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-53b1fcce-936d-4f4f-ad93-173725a3f16d tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:35.037029 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-53b1fcce-936d-4f4f-ad93-173725a3f16d tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:35.044663 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-53b1fcce-936d-4f4f-ad93-173725a3f16d tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:35.045122 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-53b1fcce-936d-4f4f-ad93-173725a3f16d tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:35.045910 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-53b1fcce-936d-4f4f-ad93-173725a3f16d tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:35.046350 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-53b1fcce-936d-4f4f-ad93-173725a3f16d tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:35.210682 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-53b1fcce-936d-4f4f-ad93-173725a3f16d tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:19:35.219115 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-53b1fcce-936d-4f4f-ad93-173725a3f16d tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1671 microversion: 2.1 time: 0.186130 Jul 22 11:19:35.219767 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 324/654] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:19:35 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1671 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:19:35.225598 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-3d76fc1f-e14b-4d25-8451-475e22c6621d tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:35.226603 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-3d76fc1f-e14b-4d25-8451-475e22c6621d tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 6d50352a-fd4f-4ca5-8e13-2519dfbb66a1] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:35.233388 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-3d76fc1f-e14b-4d25-8451-475e22c6621d tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:35.233861 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-3d76fc1f-e14b-4d25-8451-475e22c6621d tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:35.234699 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-3d76fc1f-e14b-4d25-8451-475e22c6621d tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:35.235148 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-3d76fc1f-e14b-4d25-8451-475e22c6621d tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:35.273640 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-3d76fc1f-e14b-4d25-8451-475e22c6621d tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052761 Jul 22 11:19:35.274250 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 325/655] 10.222.0.20 () {58 vars in 1301 bytes} [Fri Jul 22 11:19:35 2022] GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:19:35.928842 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-355d77e8-4759-4ea1-8b0a-f1ab022631b3 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "POST /compute/v2.1/servers/272976bd-b870-41a6-9bcd-598e1c9d34bc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.463950 Jul 22 11:19:35.929745 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 331/656] 10.222.0.20 () {60 vars in 1322 bytes} [Fri Jul 22 11:19:33 2022] POST /compute/v2.1/servers/272976bd-b870-41a6-9bcd-598e1c9d34bc/os-volume_attachments => generated 194 bytes in 2467 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:19:36.049538 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-3157d631-4d82-4f29-a032-8e82ad348d14 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:36.050138 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-3157d631-4d82-4f29-a032-8e82ad348d14 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] [instance: 39fe8666-e4cc-464c-9af9-bd43835bccf6] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:36.057534 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-3157d631-4d82-4f29-a032-8e82ad348d14 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:36.057977 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-3157d631-4d82-4f29-a032-8e82ad348d14 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:36.058781 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-3157d631-4d82-4f29-a032-8e82ad348d14 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:36.059208 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-3157d631-4d82-4f29-a032-8e82ad348d14 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:36.243922 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-7ff8e707-9cd9-4c58-913b-83edb194a51f tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:36.244647 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-7ff8e707-9cd9-4c58-913b-83edb194a51f tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:36.257340 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7ff8e707-9cd9-4c58-913b-83edb194a51f tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:36.257786 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7ff8e707-9cd9-4c58-913b-83edb194a51f tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:36.258919 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7ff8e707-9cd9-4c58-913b-83edb194a51f tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:36.259385 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7ff8e707-9cd9-4c58-913b-83edb194a51f tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:36.403841 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-3157d631-4d82-4f29-a032-8e82ad348d14 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e908d2b09dfc4a139d9c27f52580e15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84fa2f397c54be1b409d8be5ebc8491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:19:36.414901 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-3157d631-4d82-4f29-a032-8e82ad348d14 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] 10.222.0.20 "GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6" status: 200 len: 1553 microversion: 2.1 time: 0.370177 Jul 22 11:19:36.417042 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 326/657] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:19:36 2022] GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6 => generated 1553 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:19:36.424370 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-d0a29cef-d43a-4c6c-9ba6-91c2758df954 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:36.425875 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-d0a29cef-d43a-4c6c-9ba6-91c2758df954 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 6d50352a-fd4f-4ca5-8e13-2519dfbb66a1] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:36.433541 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-d0a29cef-d43a-4c6c-9ba6-91c2758df954 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:36.434977 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-d0a29cef-d43a-4c6c-9ba6-91c2758df954 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:36.436020 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-d0a29cef-d43a-4c6c-9ba6-91c2758df954 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:36.436565 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-d0a29cef-d43a-4c6c-9ba6-91c2758df954 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:36.470563 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-7ff8e707-9cd9-4c58-913b-83edb194a51f tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:19:36.473680 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-d0a29cef-d43a-4c6c-9ba6-91c2758df954 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053957 Jul 22 11:19:36.475305 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 327/658] 10.222.0.20 () {58 vars in 1301 bytes} [Fri Jul 22 11:19:36 2022] GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:19:36.485901 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-7ff8e707-9cd9-4c58-913b-83edb194a51f tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1671 microversion: 2.1 time: 0.246389 Jul 22 11:19:36.487088 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 332/659] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:19:36 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1671 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:19:36.710675 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-69f46df1-b49f-4f84-aa9f-b0f9f0d8901d tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:36.711763 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-69f46df1-b49f-4f84-aa9f-b0f9f0d8901d tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:36.721175 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-69f46df1-b49f-4f84-aa9f-b0f9f0d8901d tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:36.724591 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-69f46df1-b49f-4f84-aa9f-b0f9f0d8901d tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:36.727116 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-69f46df1-b49f-4f84-aa9f-b0f9f0d8901d tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:36.727826 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-69f46df1-b49f-4f84-aa9f-b0f9f0d8901d tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:36.758916 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG dbcounter [-] [117884] Writing DB stats nova_cell1:SELECT=100 {{(pid=117884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:19:36.773972 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-69f46df1-b49f-4f84-aa9f-b0f9f0d8901d tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54/os-volume_attachments/6c55d6d2-3a80-4306-b682-9b6e06b203e2" status: 200 len: 194 microversion: 2.20 time: 0.071800 Jul 22 11:19:36.774688 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 328/660] 10.222.0.20 () {60 vars in 1453 bytes} [Fri Jul 22 11:19:36 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54/os-volume_attachments/6c55d6d2-3a80-4306-b682-9b6e06b203e2 => generated 194 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 22 11:19:36.853801 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-40d3c1f5-58d4-4cd4-b515-b0a8fb2dae54 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:36.854682 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-40d3c1f5-58d4-4cd4-b515-b0a8fb2dae54 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:36.863547 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-40d3c1f5-58d4-4cd4-b515-b0a8fb2dae54 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:36.864004 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-40d3c1f5-58d4-4cd4-b515-b0a8fb2dae54 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:36.865218 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-40d3c1f5-58d4-4cd4-b515-b0a8fb2dae54 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:36.866424 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-40d3c1f5-58d4-4cd4-b515-b0a8fb2dae54 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:36.887004 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=5,nova_cell1:UPDATE=4 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:19:36.978316 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.objects.instance [None req-40d3c1f5-58d4-4cd4-b515-b0a8fb2dae54 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lazy-loading 'services' on Instance uuid 1f27dab8-c005-4dd0-b262-542deb60dd54 {{(pid=117885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 22 11:19:37.157293 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-40d3c1f5-58d4-4cd4-b515-b0a8fb2dae54 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54/os-volume_attachments/6c55d6d2-3a80-4306-b682-9b6e06b203e2" status: 202 len: 0 microversion: 2.20 time: 0.309666 Jul 22 11:19:37.160742 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 333/661] 10.222.0.20 () {60 vars in 1456 bytes} [Fri Jul 22 11:19:36 2022] DELETE /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54/os-volume_attachments/6c55d6d2-3a80-4306-b682-9b6e06b203e2 => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 22 11:19:37.172575 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-37ec65fd-cd38-450c-9147-e3c0633f6b70 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:37.173947 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-37ec65fd-cd38-450c-9147-e3c0633f6b70 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:37.187138 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-37ec65fd-cd38-450c-9147-e3c0633f6b70 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:37.187953 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-37ec65fd-cd38-450c-9147-e3c0633f6b70 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:37.189105 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-37ec65fd-cd38-450c-9147-e3c0633f6b70 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:37.189781 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-37ec65fd-cd38-450c-9147-e3c0633f6b70 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:37.237846 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-37ec65fd-cd38-450c-9147-e3c0633f6b70 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.068985 Jul 22 11:19:37.239573 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 329/662] 10.222.0.20 () {60 vars in 1342 bytes} [Fri Jul 22 11:19:37 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 22 11:19:37.380678 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-f631f47b-f013-4f7b-bc94-5bb4970d5719 req-609900f2-9bea-4164-9d6b-b54719ac7416 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39fe8666-e4cc-464c-9af9-bd43835bccf6", "name": "network-vif-deleted", "tag": "2dfea6d8-ff88-4cd2-885a-008177cdfd33"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:19:37.391510 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-f631f47b-f013-4f7b-bc94-5bb4970d5719 req-609900f2-9bea-4164-9d6b-b54719ac7416 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:37.392177 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-f631f47b-f013-4f7b-bc94-5bb4970d5719 req-609900f2-9bea-4164-9d6b-b54719ac7416 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:37.419708 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-f631f47b-f013-4f7b-bc94-5bb4970d5719 req-609900f2-9bea-4164-9d6b-b54719ac7416 service nova] Creating event network-vif-deleted:2dfea6d8-ff88-4cd2-885a-008177cdfd33 for instance 39fe8666-e4cc-464c-9af9-bd43835bccf6 on hv-cinder-84890 Jul 22 11:19:37.427250 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-f631f47b-f013-4f7b-bc94-5bb4970d5719 req-609900f2-9bea-4164-9d6b-b54719ac7416 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136231 Jul 22 11:19:37.429380 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 334/663] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:19:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 22 11:19:37.441025 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-e964c1f1-b2f7-469e-a1ce-88d200cfc887 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:37.441700 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-e964c1f1-b2f7-469e-a1ce-88d200cfc887 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] [instance: 39fe8666-e4cc-464c-9af9-bd43835bccf6] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:37.463446 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-e964c1f1-b2f7-469e-a1ce-88d200cfc887 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:37.464129 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-e964c1f1-b2f7-469e-a1ce-88d200cfc887 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:37.465344 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-e964c1f1-b2f7-469e-a1ce-88d200cfc887 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:37.466009 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-e964c1f1-b2f7-469e-a1ce-88d200cfc887 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:37.490490 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-10bef544-f2b7-4b58-8787-efce38138475 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:37.491600 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-10bef544-f2b7-4b58-8787-efce38138475 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 6d50352a-fd4f-4ca5-8e13-2519dfbb66a1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:37.499201 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-10bef544-f2b7-4b58-8787-efce38138475 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:37.499971 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-10bef544-f2b7-4b58-8787-efce38138475 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:37.501042 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-10bef544-f2b7-4b58-8787-efce38138475 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:37.501820 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-10bef544-f2b7-4b58-8787-efce38138475 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:37.515927 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-e964c1f1-b2f7-469e-a1ce-88d200cfc887 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:37.516968 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-e964c1f1-b2f7-469e-a1ce-88d200cfc887 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:37.517731 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.objects.instance [None req-e964c1f1-b2f7-469e-a1ce-88d200cfc887 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lazy-loading 'fault' on Instance uuid 39fe8666-e4cc-464c-9af9-bd43835bccf6 {{(pid=117884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 22 11:19:37.543497 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-10bef544-f2b7-4b58-8787-efce38138475 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058665 Jul 22 11:19:37.544092 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 335/664] 10.222.0.20 () {58 vars in 1301 bytes} [Fri Jul 22 11:19:37 2022] GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 22 11:19:37.550385 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-3825c1ec-d323-42d8-b8c1-90cb91b7158c tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:37.556953 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-3825c1ec-d323-42d8-b8c1-90cb91b7158c tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:37.567565 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3825c1ec-d323-42d8-b8c1-90cb91b7158c tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:37.568308 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3825c1ec-d323-42d8-b8c1-90cb91b7158c tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:37.569863 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3825c1ec-d323-42d8-b8c1-90cb91b7158c tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:37.570467 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3825c1ec-d323-42d8-b8c1-90cb91b7158c tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:37.687153 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-3825c1ec-d323-42d8-b8c1-90cb91b7158c tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:19:37.695926 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-3825c1ec-d323-42d8-b8c1-90cb91b7158c tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1604 microversion: 2.1 time: 0.149680 Jul 22 11:19:37.696534 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 336/665] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:19:37 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1604 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:19:37.701677 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-d46372bc-343d-4dc1-bebd-a9dabe249fad tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:37.702560 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-d46372bc-343d-4dc1-bebd-a9dabe249fad tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 6d50352a-fd4f-4ca5-8e13-2519dfbb66a1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:37.710663 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d46372bc-343d-4dc1-bebd-a9dabe249fad tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:37.711179 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d46372bc-343d-4dc1-bebd-a9dabe249fad tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:37.712348 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d46372bc-343d-4dc1-bebd-a9dabe249fad tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:37.712988 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d46372bc-343d-4dc1-bebd-a9dabe249fad tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:37.755739 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-d46372bc-343d-4dc1-bebd-a9dabe249fad tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 6d50352a-fd4f-4ca5-8e13-2519dfbb66a1] Going to try to terminate instance {{(pid=117885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 22 11:19:37.904744 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-e964c1f1-b2f7-469e-a1ce-88d200cfc887 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e908d2b09dfc4a139d9c27f52580e15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84fa2f397c54be1b409d8be5ebc8491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:19:37.914743 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-e964c1f1-b2f7-469e-a1ce-88d200cfc887 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] 10.222.0.20 "GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6" status: 200 len: 1348 microversion: 2.1 time: 0.479975 Jul 22 11:19:37.919077 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 330/666] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:19:37 2022] GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6 => generated 1348 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:19:37.926669 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-d46372bc-343d-4dc1-bebd-a9dabe249fad tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1" status: 204 len: 0 microversion: 2.1 time: 0.217534 Jul 22 11:19:37.927440 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 337/667] 10.222.0.20 () {58 vars in 1238 bytes} [Fri Jul 22 11:19:37 2022] DELETE /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 22 11:19:37.942565 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-946f660e-c73c-4c8b-83e9-117c9792194a tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:37.944206 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-946f660e-c73c-4c8b-83e9-117c9792194a tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 6d50352a-fd4f-4ca5-8e13-2519dfbb66a1] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:37.960058 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-946f660e-c73c-4c8b-83e9-117c9792194a tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:37.960716 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-946f660e-c73c-4c8b-83e9-117c9792194a tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:37.964552 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-946f660e-c73c-4c8b-83e9-117c9792194a tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:37.965237 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-946f660e-c73c-4c8b-83e9-117c9792194a tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:38.237848 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-946f660e-c73c-4c8b-83e9-117c9792194a tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:19:38.253458 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-d40a9b2d-f98d-42cd-80fd-31d624c66832 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:38.254326 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-946f660e-c73c-4c8b-83e9-117c9792194a tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1" status: 200 len: 1689 microversion: 2.1 time: 0.316881 Jul 22 11:19:38.254484 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-d40a9b2d-f98d-42cd-80fd-31d624c66832 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:38.256022 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 331/668] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:19:37 2022] GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1 => generated 1689 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:19:38.261291 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d40a9b2d-f98d-42cd-80fd-31d624c66832 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:38.261741 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d40a9b2d-f98d-42cd-80fd-31d624c66832 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:38.262545 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d40a9b2d-f98d-42cd-80fd-31d624c66832 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:38.262984 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d40a9b2d-f98d-42cd-80fd-31d624c66832 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:38.307912 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-d40a9b2d-f98d-42cd-80fd-31d624c66832 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058945 Jul 22 11:19:38.308497 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 338/669] 10.222.0.20 () {60 vars in 1342 bytes} [Fri Jul 22 11:19:38 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 22 11:19:38.715041 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-c2842e63-8f99-4ecd-b51b-ea51be288bdc tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:38.715868 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-c2842e63-8f99-4ecd-b51b-ea51be288bdc tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:38.722610 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c2842e63-8f99-4ecd-b51b-ea51be288bdc tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:38.723058 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c2842e63-8f99-4ecd-b51b-ea51be288bdc tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:38.723851 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c2842e63-8f99-4ecd-b51b-ea51be288bdc tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:38.724320 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c2842e63-8f99-4ecd-b51b-ea51be288bdc tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:38.798838 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-c2842e63-8f99-4ecd-b51b-ea51be288bdc tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:19:38.808250 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-c2842e63-8f99-4ecd-b51b-ea51be288bdc tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1604 microversion: 2.1 time: 0.097384 Jul 22 11:19:38.808835 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 332/670] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:19:38 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1604 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:19:38.933967 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-6be39a8d-a098-40e7-8546-10a80910120a tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:38.934584 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-6be39a8d-a098-40e7-8546-10a80910120a tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] [instance: 39fe8666-e4cc-464c-9af9-bd43835bccf6] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:38.941517 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6be39a8d-a098-40e7-8546-10a80910120a tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:38.941962 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6be39a8d-a098-40e7-8546-10a80910120a tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:38.942734 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6be39a8d-a098-40e7-8546-10a80910120a tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:38.943161 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6be39a8d-a098-40e7-8546-10a80910120a tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:38.958680 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.wsgi [None req-6be39a8d-a098-40e7-8546-10a80910120a tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] HTTP exception thrown: Instance 39fe8666-e4cc-464c-9af9-bd43835bccf6 could not be found. Jul 22 11:19:38.960938 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-6be39a8d-a098-40e7-8546-10a80910120a tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Request method failure captured: Jul 22 11:19:38.960938 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: request: GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6 HTTP/1.1 Jul 22 11:19:38.960938 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Accept: application/json Jul 22 11:19:38.960938 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Accept-Encoding: identity Jul 22 11:19:38.960938 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Connection: close Jul 22 11:19:38.960938 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Content-Length: 0 Jul 22 11:19:38.960938 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Content-Type: application/json Jul 22 11:19:38.960938 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Host: 10.222.0.20 Jul 22 11:19:38.960938 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Openstack-System-Scope: None Jul 22 11:19:38.960938 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: User-Agent: python-urllib3/1.26.9 Jul 22 11:19:38.960938 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Auth-Token: gAAAAABi2obRTKoDvbTtlJ-MjQVjFfg3n9mx67zwsPSgkjZq80P8x861li8frsT586ETZ3WY0NISC7omQZ83tel7IFoEOoAh_uot6w0nqz3xGQcM5vFrNDrQiZQ0e5cu8s1_n1ds25rYlp_XptCLTFxfkA2dDzMT-P-KEk9ean9Ma3PKr8PnbO0 Jul 22 11:19:38.960938 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Domain-Id: None Jul 22 11:19:38.960938 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Domain-Name: None Jul 22 11:19:38.960938 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Identity-Status: Confirmed Jul 22 11:19:38.960938 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Is-Admin-Project: True Jul 22 11:19:38.960938 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Project-Domain-Id: default Jul 22 11:19:38.960938 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Project-Domain-Name: Default Jul 22 11:19:38.960938 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Project-Id: a84fa2f397c54be1b409d8be5ebc8491 Jul 22 11:19:38.960938 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Project-Name: tempest-TestMinimumBasicScenario-1887984995 Jul 22 11:19:38.960938 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Role: reader,member Jul 22 11:19:38.960938 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Roles: reader,member Jul 22 11:19:38.962763 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a84fa2f397c54be1b409d8be5ebc8491"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a84fa2f397c54be1b409d8be5ebc8491", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a84fa2f397c54be1b409d8be5ebc8491"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a84fa2f397c54be1b409d8be5ebc8491"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jul 22 11:19:38.962763 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Tenant: tempest-TestMinimumBasicScenario-1887984995 Jul 22 11:19:38.962763 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Tenant-Id: a84fa2f397c54be1b409d8be5ebc8491 Jul 22 11:19:38.962763 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1887984995 Jul 22 11:19:38.962763 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User: tempest-TestMinimumBasicScenario-1887984995-project Jul 22 11:19:38.962763 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User-Domain-Id: default Jul 22 11:19:38.962763 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User-Domain-Name: Default Jul 22 11:19:38.962763 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User-Id: e908d2b09dfc4a139d9c27f52580e15b Jul 22 11:19:38.962763 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User-Name: tempest-TestMinimumBasicScenario-1887984995-project Jul 22 11:19:38.962763 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: method: > Jul 22 11:19:38.962763 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: exception: Instance 39fe8666-e4cc-464c-9af9-bd43835bccf6 could not be found. Jul 22 11:19:38.962763 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: action_args: {'id': '39fe8666-e4cc-464c-9af9-bd43835bccf6'} Jul 22 11:19:38.963803 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 22 11:19:38.963803 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:19:38.963803 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 22 11:19:38.963803 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 22 11:19:38.963803 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 22 11:19:38.963803 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 22 11:19:38.963803 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 22 11:19:38.963803 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 22 11:19:38.963803 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 22 11:19:38.963803 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 22 11:19:38.963803 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39fe8666-e4cc-464c-9af9-bd43835bccf6 could not be found. Jul 22 11:19:38.963803 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:19:38.963803 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:19:38.963803 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:19:38.963803 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:19:38.963803 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:19:38.963803 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:19:38.963803 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 22 11:19:38.963803 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 22 11:19:38.963803 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 22 11:19:38.965585 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 22 11:19:38.965585 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 22 11:19:38.965585 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 22 11:19:38.965585 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 22 11:19:38.965585 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 22 11:19:38.965585 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 22 11:19:38.965585 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 22 11:19:38.965585 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39fe8666-e4cc-464c-9af9-bd43835bccf6 could not be found. Jul 22 11:19:38.965585 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:19:38.965585 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:19:38.965585 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:19:38.965585 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:19:38.965585 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:19:38.965585 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:19:38.965585 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 22 11:19:38.965585 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 22 11:19:38.965585 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39fe8666-e4cc-464c-9af9-bd43835bccf6 could not be found. Jul 22 11:19:38.965585 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:19:38.966979 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-6be39a8d-a098-40e7-8546-10a80910120a tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Returning 404 to user: Instance 39fe8666-e4cc-464c-9af9-bd43835bccf6 could not be found. {{(pid=117885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 22 11:19:38.966979 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-6be39a8d-a098-40e7-8546-10a80910120a tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] 10.222.0.20 "GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6" status: 404 len: 111 microversion: 2.1 time: 0.032274 Jul 22 11:19:38.966979 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 339/671] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:19:38 2022] GET /compute/v2.1/servers/39fe8666-e4cc-464c-9af9-bd43835bccf6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 22 11:19:38.973419 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-c24b59c9-79b8-47fb-aadb-38e6c4253f94 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] Calling method '.version_select at 0x7f84450ca0d0>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:38.994705 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-c24b59c9-79b8-47fb-aadb-38e6c4253f94 tempest-TestMinimumBasicScenario-1887984995 tempest-TestMinimumBasicScenario-1887984995-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-468330005" status: 202 len: 0 microversion: 2.1 time: 0.025930 Jul 22 11:19:38.995339 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 333/672] 10.222.0.20 () {58 vars in 1268 bytes} [Fri Jul 22 11:19:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-468330005 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 22 11:19:39.270506 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-093c912f-303c-4095-a17e-11840af25e6b tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:39.271310 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-093c912f-303c-4095-a17e-11840af25e6b tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 6d50352a-fd4f-4ca5-8e13-2519dfbb66a1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:39.280098 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-093c912f-303c-4095-a17e-11840af25e6b tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:39.280555 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-093c912f-303c-4095-a17e-11840af25e6b tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:39.281354 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-093c912f-303c-4095-a17e-11840af25e6b tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:39.281788 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-093c912f-303c-4095-a17e-11840af25e6b tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:39.320711 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-9ebc782b-a4bd-40c5-a682-fe504eefaeee tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:39.322165 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-9ebc782b-a4bd-40c5-a682-fe504eefaeee tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:39.331651 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-9ebc782b-a4bd-40c5-a682-fe504eefaeee tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:39.332199 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-9ebc782b-a4bd-40c5-a682-fe504eefaeee tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:39.335596 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-9ebc782b-a4bd-40c5-a682-fe504eefaeee tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:39.336046 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-9ebc782b-a4bd-40c5-a682-fe504eefaeee tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:39.377483 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-9ebc782b-a4bd-40c5-a682-fe504eefaeee tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.061839 Jul 22 11:19:39.383062 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 334/673] 10.222.0.20 () {60 vars in 1342 bytes} [Fri Jul 22 11:19:39 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 22 11:19:39.450196 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-093c912f-303c-4095-a17e-11840af25e6b tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:19:39.453992 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [req-032c58d9-f658-49a9-a55a-a6630f50c838 req-9a228e62-4e98-426b-87d1-b810f97eccf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cafe061-7a16-4c2c-8796-da7dac3f27f1", "name": "network-vif-deleted", "tag": "d89d05f5-4d23-40cd-88f2-d3ff71f50ba0"}]} {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:19:39.459403 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-093c912f-303c-4095-a17e-11840af25e6b tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1" status: 200 len: 1689 microversion: 2.1 time: 0.192656 Jul 22 11:19:39.460602 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 340/674] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:19:39 2022] GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1 => generated 1689 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:19:39.471985 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-032c58d9-f658-49a9-a55a-a6630f50c838 req-9a228e62-4e98-426b-87d1-b810f97eccf5 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:39.472483 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-032c58d9-f658-49a9-a55a-a6630f50c838 req-9a228e62-4e98-426b-87d1-b810f97eccf5 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:39.485067 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.compute.server_external_events [req-032c58d9-f658-49a9-a55a-a6630f50c838 req-9a228e62-4e98-426b-87d1-b810f97eccf5 service nova] Creating event network-vif-deleted:d89d05f5-4d23-40cd-88f2-d3ff71f50ba0 for instance 1cafe061-7a16-4c2c-8796-da7dac3f27f1 on hv-cinder-84890 Jul 22 11:19:39.491465 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [req-032c58d9-f658-49a9-a55a-a6630f50c838 req-9a228e62-4e98-426b-87d1-b810f97eccf5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041369 Jul 22 11:19:39.492369 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 335/675] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:19:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:19:39.831191 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-683fc4a6-44bd-430b-93be-a42767478749 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:39.831718 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-683fc4a6-44bd-430b-93be-a42767478749 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:39.839478 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-683fc4a6-44bd-430b-93be-a42767478749 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:39.839928 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-683fc4a6-44bd-430b-93be-a42767478749 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:39.840704 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-683fc4a6-44bd-430b-93be-a42767478749 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:39.841204 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-683fc4a6-44bd-430b-93be-a42767478749 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:39.917511 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-683fc4a6-44bd-430b-93be-a42767478749 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:19:39.926479 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-683fc4a6-44bd-430b-93be-a42767478749 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1604 microversion: 2.1 time: 0.100198 Jul 22 11:19:39.927064 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 341/676] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:19:39 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1604 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:19:40.391362 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-dd619139-0b09-4320-bdf3-7cc94b33ac15 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:40.392424 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-dd619139-0b09-4320-bdf3-7cc94b33ac15 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:40.399489 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-dd619139-0b09-4320-bdf3-7cc94b33ac15 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:40.399945 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-dd619139-0b09-4320-bdf3-7cc94b33ac15 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:40.400724 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-dd619139-0b09-4320-bdf3-7cc94b33ac15 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:40.401162 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-dd619139-0b09-4320-bdf3-7cc94b33ac15 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:40.433841 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-dd619139-0b09-4320-bdf3-7cc94b33ac15 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047320 Jul 22 11:19:40.435354 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 336/677] 10.222.0.20 () {60 vars in 1342 bytes} [Fri Jul 22 11:19:40 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 22 11:19:40.477452 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-fc8c9fa1-cbe5-42e9-b85e-b09a3a236833 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:40.478169 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-fc8c9fa1-cbe5-42e9-b85e-b09a3a236833 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 6d50352a-fd4f-4ca5-8e13-2519dfbb66a1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:40.484778 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fc8c9fa1-cbe5-42e9-b85e-b09a3a236833 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:40.485307 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fc8c9fa1-cbe5-42e9-b85e-b09a3a236833 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:40.486139 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fc8c9fa1-cbe5-42e9-b85e-b09a3a236833 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:40.486637 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fc8c9fa1-cbe5-42e9-b85e-b09a3a236833 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:40.654246 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-fc8c9fa1-cbe5-42e9-b85e-b09a3a236833 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:19:40.663625 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-fc8c9fa1-cbe5-42e9-b85e-b09a3a236833 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1" status: 200 len: 1689 microversion: 2.1 time: 0.190105 Jul 22 11:19:40.665271 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 342/678] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:19:40 2022] GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1 => generated 1689 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:19:40.944776 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-e0cd76cb-5686-4c5d-8197-cc1a5eb6b47a tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:40.945387 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-e0cd76cb-5686-4c5d-8197-cc1a5eb6b47a tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:40.951837 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-e0cd76cb-5686-4c5d-8197-cc1a5eb6b47a tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:40.952278 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-e0cd76cb-5686-4c5d-8197-cc1a5eb6b47a tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:40.953061 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-e0cd76cb-5686-4c5d-8197-cc1a5eb6b47a tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:40.953488 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-e0cd76cb-5686-4c5d-8197-cc1a5eb6b47a tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:41.053464 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-e0cd76cb-5686-4c5d-8197-cc1a5eb6b47a tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:19:41.061580 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-e0cd76cb-5686-4c5d-8197-cc1a5eb6b47a tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 200 len: 1604 microversion: 2.1 time: 0.121276 Jul 22 11:19:41.062168 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 337/679] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:19:40 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 1604 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:19:41.453469 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-9e9186d7-cd5f-41cc-b00b-2819cb933c85 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:41.455298 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-9e9186d7-cd5f-41cc-b00b-2819cb933c85 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:41.465544 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9e9186d7-cd5f-41cc-b00b-2819cb933c85 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:41.466688 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9e9186d7-cd5f-41cc-b00b-2819cb933c85 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:41.469838 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9e9186d7-cd5f-41cc-b00b-2819cb933c85 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:41.470499 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9e9186d7-cd5f-41cc-b00b-2819cb933c85 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:41.519246 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-9e9186d7-cd5f-41cc-b00b-2819cb933c85 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.072919 Jul 22 11:19:41.523395 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 343/680] 10.222.0.20 () {60 vars in 1342 bytes} [Fri Jul 22 11:19:41 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 22 11:19:41.682268 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-811ce218-9597-4005-94c5-c0fcc0f11fe9 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:41.683043 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-811ce218-9597-4005-94c5-c0fcc0f11fe9 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 6d50352a-fd4f-4ca5-8e13-2519dfbb66a1] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:41.690169 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-811ce218-9597-4005-94c5-c0fcc0f11fe9 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:41.691384 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-811ce218-9597-4005-94c5-c0fcc0f11fe9 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:41.692636 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-811ce218-9597-4005-94c5-c0fcc0f11fe9 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:41.692636 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-811ce218-9597-4005-94c5-c0fcc0f11fe9 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:42.079744 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-406acc7f-567e-42ed-936f-65924061abbf tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:42.080384 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-406acc7f-567e-42ed-936f-65924061abbf tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:42.088589 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-406acc7f-567e-42ed-936f-65924061abbf tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:42.089049 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-406acc7f-567e-42ed-936f-65924061abbf tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:42.089828 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-406acc7f-567e-42ed-936f-65924061abbf tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:42.090266 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-406acc7f-567e-42ed-936f-65924061abbf tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:42.106236 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.wsgi [None req-406acc7f-567e-42ed-936f-65924061abbf tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] HTTP exception thrown: Instance 1cafe061-7a16-4c2c-8796-da7dac3f27f1 could not be found. Jul 22 11:19:42.107835 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-406acc7f-567e-42ed-936f-65924061abbf tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Request method failure captured: Jul 22 11:19:42.107835 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: request: GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 HTTP/1.1 Jul 22 11:19:42.107835 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Accept: application/json Jul 22 11:19:42.107835 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Accept-Encoding: identity Jul 22 11:19:42.107835 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Connection: close Jul 22 11:19:42.107835 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Content-Length: 0 Jul 22 11:19:42.107835 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Content-Type: application/json Jul 22 11:19:42.107835 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Host: 10.222.0.20 Jul 22 11:19:42.107835 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Openstack-System-Scope: None Jul 22 11:19:42.107835 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: User-Agent: python-urllib3/1.26.9 Jul 22 11:19:42.107835 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Auth-Token: gAAAAABi2oaCb6ZjdjoanfH_h9JPTqUp87mECBfq6-I-9jVCGnbw8DfIWpDq0WQ-nwPfGPDYfE40GlNjoCi25niz0gIt1tm70rKYhZ61iiEYO1DvkXJrAD9ZDO725FdcAppHCkweptc0h1Fo_PqV4DqPUPDrspxgeORVq6BMRXo9ntRdE9YcA4Y Jul 22 11:19:42.107835 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Domain-Id: None Jul 22 11:19:42.107835 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Domain-Name: None Jul 22 11:19:42.107835 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Identity-Status: Confirmed Jul 22 11:19:42.107835 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Is-Admin-Project: True Jul 22 11:19:42.107835 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Project-Domain-Id: default Jul 22 11:19:42.107835 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Project-Domain-Name: Default Jul 22 11:19:42.107835 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Project-Id: f50a15db11214fb5a637fb400dcd928f Jul 22 11:19:42.107835 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Project-Name: tempest-AttachVolumeTestJSON-127223071 Jul 22 11:19:42.107835 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Role: reader,member Jul 22 11:19:42.107835 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Roles: reader,member Jul 22 11:19:42.109163 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f50a15db11214fb5a637fb400dcd928f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f50a15db11214fb5a637fb400dcd928f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f50a15db11214fb5a637fb400dcd928f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f50a15db11214fb5a637fb400dcd928f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jul 22 11:19:42.109163 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Tenant: tempest-AttachVolumeTestJSON-127223071 Jul 22 11:19:42.109163 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Tenant-Id: f50a15db11214fb5a637fb400dcd928f Jul 22 11:19:42.109163 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Tenant-Name: tempest-AttachVolumeTestJSON-127223071 Jul 22 11:19:42.109163 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User: tempest-AttachVolumeTestJSON-127223071-project Jul 22 11:19:42.109163 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User-Domain-Id: default Jul 22 11:19:42.109163 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User-Domain-Name: Default Jul 22 11:19:42.109163 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User-Id: da75b78b267f47e8aaaafb41e3acb61a Jul 22 11:19:42.109163 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User-Name: tempest-AttachVolumeTestJSON-127223071-project Jul 22 11:19:42.109163 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: method: > Jul 22 11:19:42.109163 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: exception: Instance 1cafe061-7a16-4c2c-8796-da7dac3f27f1 could not be found. Jul 22 11:19:42.109163 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: action_args: {'id': '1cafe061-7a16-4c2c-8796-da7dac3f27f1'} Jul 22 11:19:42.109947 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 22 11:19:42.109947 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:19:42.109947 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 22 11:19:42.109947 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 22 11:19:42.109947 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 22 11:19:42.109947 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 22 11:19:42.109947 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 22 11:19:42.109947 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 22 11:19:42.109947 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 22 11:19:42.109947 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 22 11:19:42.109947 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cafe061-7a16-4c2c-8796-da7dac3f27f1 could not be found. Jul 22 11:19:42.109947 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:19:42.109947 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:19:42.109947 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:19:42.109947 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:19:42.109947 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:19:42.109947 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:19:42.109947 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 22 11:19:42.109947 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 22 11:19:42.109947 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 22 11:19:42.111095 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 22 11:19:42.111095 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 22 11:19:42.111095 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 22 11:19:42.111095 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 22 11:19:42.111095 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 22 11:19:42.111095 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 22 11:19:42.111095 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 22 11:19:42.111095 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cafe061-7a16-4c2c-8796-da7dac3f27f1 could not be found. Jul 22 11:19:42.111095 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:19:42.111095 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:19:42.111095 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:19:42.111095 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:19:42.111095 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:19:42.111095 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:19:42.111095 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 22 11:19:42.111095 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 22 11:19:42.111095 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cafe061-7a16-4c2c-8796-da7dac3f27f1 could not be found. Jul 22 11:19:42.111095 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:19:42.112798 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-406acc7f-567e-42ed-936f-65924061abbf tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Returning 404 to user: Instance 1cafe061-7a16-4c2c-8796-da7dac3f27f1 could not be found. {{(pid=117885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 22 11:19:42.112798 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-406acc7f-567e-42ed-936f-65924061abbf tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 404 len: 111 microversion: 2.1 time: 0.034407 Jul 22 11:19:42.112798 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 344/681] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:19:42 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 22 11:19:42.122488 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-96774226-b955-471e-8a21-e823dcb15be9 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '.version_select at 0x7f844517d790>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:42.143618 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-96774226-b955-471e-8a21-e823dcb15be9 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-5927667" status: 202 len: 0 microversion: 2.1 time: 0.024829 Jul 22 11:19:42.144205 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 345/682] 10.222.0.20 () {58 vars in 1211 bytes} [Fri Jul 22 11:19:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-5927667 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 22 11:19:42.395627 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-811ce218-9597-4005-94c5-c0fcc0f11fe9 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:19:42.412788 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-811ce218-9597-4005-94c5-c0fcc0f11fe9 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1" status: 200 len: 1689 microversion: 2.1 time: 0.735237 Jul 22 11:19:42.413749 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 338/683] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:19:41 2022] GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1 => generated 1689 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:19:42.531694 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-7a0e1814-b447-4b72-9c0d-f2722cf55cd1 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:42.533214 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-7a0e1814-b447-4b72-9c0d-f2722cf55cd1 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:42.541510 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7a0e1814-b447-4b72-9c0d-f2722cf55cd1 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:42.542236 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7a0e1814-b447-4b72-9c0d-f2722cf55cd1 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:42.543020 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7a0e1814-b447-4b72-9c0d-f2722cf55cd1 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:42.543509 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7a0e1814-b447-4b72-9c0d-f2722cf55cd1 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:42.586980 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-7a0e1814-b447-4b72-9c0d-f2722cf55cd1 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059761 Jul 22 11:19:42.587607 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 346/684] 10.222.0.20 () {60 vars in 1342 bytes} [Fri Jul 22 11:19:42 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 22 11:19:43.322184 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [req-f0c2b35a-1d0e-4c53-9a48-4e524390b3bf req-5718c039-a251-4391-8be3-8274889185a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d50352a-fd4f-4ca5-8e13-2519dfbb66a1", "name": "network-vif-deleted", "tag": "fa52f10e-8382-40d6-8633-f6bcf76980e8"}]} {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:19:43.338910 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-6795fa99-242a-421c-b9ec-4df9b948f9b0 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Action: 'create', calling method: .version_select at 0x7f84450d1ca0>, body: {"keypair": {"name": "tempest-keypair-848028287", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJSME5xKG+HU/yXsnTdJaKq1syY1Vyfw/He9vrIAqRWH0oFtKFptmvT4vEqHrfWKXhks25E/D+4lvqt2l8W9SPAek8C1fxDuuNvxHpliDaID+9YiDaP/E1+6Fyyx9OABcQ=="}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:19:43.339763 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-f0c2b35a-1d0e-4c53-9a48-4e524390b3bf req-5718c039-a251-4391-8be3-8274889185a4 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:43.340456 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-f0c2b35a-1d0e-4c53-9a48-4e524390b3bf req-5718c039-a251-4391-8be3-8274889185a4 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:43.353868 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.compute.server_external_events [req-f0c2b35a-1d0e-4c53-9a48-4e524390b3bf req-5718c039-a251-4391-8be3-8274889185a4 service nova] Creating event network-vif-deleted:fa52f10e-8382-40d6-8633-f6bcf76980e8 for instance 6d50352a-fd4f-4ca5-8e13-2519dfbb66a1 on hv-cinder-84890 Jul 22 11:19:43.359401 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-6795fa99-242a-421c-b9ec-4df9b948f9b0 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Getting quotas for project f50a15db11214fb5a637fb400dcd928f. Resources: {'key_pairs'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 22 11:19:43.360110 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [req-f0c2b35a-1d0e-4c53-9a48-4e524390b3bf req-5718c039-a251-4391-8be3-8274889185a4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041250 Jul 22 11:19:43.361261 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 339/685] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:19:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:19:43.368160 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-6795fa99-242a-421c-b9ec-4df9b948f9b0 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Getting quotas for user da75b78b267f47e8aaaafb41e3acb61a and project f50a15db11214fb5a637fb400dcd928f. Resources: {'key_pairs'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 22 11:19:43.403397 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-6795fa99-242a-421c-b9ec-4df9b948f9b0 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.070868 Jul 22 11:19:43.404648 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 347/686] 10.222.0.20 () {60 vars in 1158 bytes} [Fri Jul 22 11:19:43 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:19:43.441660 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-945a368b-7ac5-4c45-8b3d-b6f00eaf1e7f tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:43.443752 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-945a368b-7ac5-4c45-8b3d-b6f00eaf1e7f tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 6d50352a-fd4f-4ca5-8e13-2519dfbb66a1] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:43.465769 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-945a368b-7ac5-4c45-8b3d-b6f00eaf1e7f tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:43.469163 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-945a368b-7ac5-4c45-8b3d-b6f00eaf1e7f tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:43.472648 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-945a368b-7ac5-4c45-8b3d-b6f00eaf1e7f tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:43.474751 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-945a368b-7ac5-4c45-8b3d-b6f00eaf1e7f tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:43.602890 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-b31a81c9-d749-415a-a358-95168b7320e7 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:43.603878 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-b31a81c9-d749-415a-a358-95168b7320e7 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:43.630692 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b31a81c9-d749-415a-a358-95168b7320e7 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:43.632976 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b31a81c9-d749-415a-a358-95168b7320e7 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:43.634917 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b31a81c9-d749-415a-a358-95168b7320e7 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:43.636156 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b31a81c9-d749-415a-a358-95168b7320e7 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:43.659785 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-945a368b-7ac5-4c45-8b3d-b6f00eaf1e7f tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:19:43.684074 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-945a368b-7ac5-4c45-8b3d-b6f00eaf1e7f tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1" status: 200 len: 1621 microversion: 2.1 time: 0.254686 Jul 22 11:19:43.687217 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 340/687] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:19:43 2022] GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1 => generated 1621 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:19:43.708178 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-17548313-14e9-4c94-9c80-d7fef563ae02 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ad33c2ab-3366-4c02-b53b-7c6f2f789506"}} {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:19:43.710992 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-17548313-14e9-4c94-9c80-d7fef563ae02 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 272976bd-b870-41a6-9bcd-598e1c9d34bc] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:43.714997 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-b31a81c9-d749-415a-a358-95168b7320e7 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.118721 Jul 22 11:19:43.715660 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 348/688] 10.222.0.20 () {60 vars in 1342 bytes} [Fri Jul 22 11:19:43 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 22 11:19:43.729862 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-17548313-14e9-4c94-9c80-d7fef563ae02 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:43.730702 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-17548313-14e9-4c94-9c80-d7fef563ae02 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:43.731774 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-17548313-14e9-4c94-9c80-d7fef563ae02 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:43.732612 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-17548313-14e9-4c94-9c80-d7fef563ae02 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:43.926189 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.wsgi [None req-17548313-14e9-4c94-9c80-d7fef563ae02 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] HTTP exception thrown: Invalid volume: volume ad33c2ab-3366-4c02-b53b-7c6f2f789506 is already attached to instances: 272976bd-b870-41a6-9bcd-598e1c9d34bc Jul 22 11:19:43.933011 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-17548313-14e9-4c94-9c80-d7fef563ae02 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Request method failure captured: Jul 22 11:19:43.933011 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: request: POST /compute/v2.1/servers/272976bd-b870-41a6-9bcd-598e1c9d34bc/os-volume_attachments HTTP/1.1 Jul 22 11:19:43.933011 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Accept: application/json Jul 22 11:19:43.933011 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Accept-Encoding: identity Jul 22 11:19:43.933011 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Connection: close Jul 22 11:19:43.933011 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Content-Length: 74 Jul 22 11:19:43.933011 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Content-Type: application/json Jul 22 11:19:43.933011 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Host: 10.222.0.20 Jul 22 11:19:43.933011 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Openstack-System-Scope: None Jul 22 11:19:43.933011 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: User-Agent: python-urllib3/1.26.9 Jul 22 11:19:43.933011 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Auth-Token: gAAAAABi2oZ52By6vC80uVvQ5nsWGLE19ZXI57S3ld1fjPibH8fuUYjCV8gJDPh42GzMe4RKMojTgGaj2CCjG1yohpK4Rm5k-mOJAFOmJU-P2lN4F8UiP8lUppBYVH0uVfdef6vJD72z_c72VmeWRwsVQhXxsOTWQe5Gh1G1aCThgwUg9CYgRRw Jul 22 11:19:43.933011 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Domain-Id: None Jul 22 11:19:43.933011 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Domain-Name: None Jul 22 11:19:43.933011 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Identity-Status: Confirmed Jul 22 11:19:43.933011 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Is-Admin-Project: True Jul 22 11:19:43.933011 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Domain-Id: default Jul 22 11:19:43.933011 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Domain-Name: Default Jul 22 11:19:43.933011 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Id: 28836b7cb9c646aaaa1bb1c1fae68128 Jul 22 11:19:43.933011 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Name: tempest-AttachVolumeNegativeTest-1017563372 Jul 22 11:19:43.933011 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Role: reader,member Jul 22 11:19:43.933011 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Roles: reader,member Jul 22 11:19:43.934637 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/28836b7cb9c646aaaa1bb1c1fae68128"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_28836b7cb9c646aaaa1bb1c1fae68128", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/28836b7cb9c646aaaa1bb1c1fae68128"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/28836b7cb9c646aaaa1bb1c1fae68128"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jul 22 11:19:43.934637 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant: tempest-AttachVolumeNegativeTest-1017563372 Jul 22 11:19:43.934637 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant-Id: 28836b7cb9c646aaaa1bb1c1fae68128 Jul 22 11:19:43.934637 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1017563372 Jul 22 11:19:43.934637 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User: tempest-AttachVolumeNegativeTest-1017563372-project Jul 22 11:19:43.934637 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Domain-Id: default Jul 22 11:19:43.934637 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Domain-Name: Default Jul 22 11:19:43.934637 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Id: 691877dce1024aeda61629073d74602b Jul 22 11:19:43.934637 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Name: tempest-AttachVolumeNegativeTest-1017563372-project Jul 22 11:19:43.934637 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Jul 22 11:19:43.934637 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: {"volumeAttachment": {"volumeId": "ad33c2ab-3366-4c02-b53b-7c6f2f789506"}} Jul 22 11:19:43.934637 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: method: > Jul 22 11:19:43.935492 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: exception: Invalid volume: volume ad33c2ab-3366-4c02-b53b-7c6f2f789506 is already attached to instances: 272976bd-b870-41a6-9bcd-598e1c9d34bc Jul 22 11:19:43.935492 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: action_args: {'server_id': '272976bd-b870-41a6-9bcd-598e1c9d34bc', 'body': {'volumeAttachment': {'volumeId': 'ad33c2ab-3366-4c02-b53b-7c6f2f789506'}}} Jul 22 11:19:43.935492 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 22 11:19:43.935492 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:19:43.935492 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 22 11:19:43.935492 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 22 11:19:43.935492 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 22 11:19:43.935492 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 22 11:19:43.935492 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 22 11:19:43.935492 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 22 11:19:43.935492 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 22 11:19:43.935492 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 22 11:19:43.935492 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 22 11:19:43.935492 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 22 11:19:43.935492 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume ad33c2ab-3366-4c02-b53b-7c6f2f789506 is already attached to instances: 272976bd-b870-41a6-9bcd-598e1c9d34bc Jul 22 11:19:43.935492 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:19:43.935492 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:19:43.935492 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:19:43.935492 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:19:43.940987 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:19:43.940987 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:19:43.940987 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 22 11:19:43.940987 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 22 11:19:43.940987 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 22 11:19:43.940987 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 22 11:19:43.940987 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 22 11:19:43.940987 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 22 11:19:43.940987 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 22 11:19:43.940987 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 22 11:19:43.940987 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 22 11:19:43.940987 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 22 11:19:43.940987 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 22 11:19:43.940987 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 22 11:19:43.940987 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume ad33c2ab-3366-4c02-b53b-7c6f2f789506 is already attached to instances: 272976bd-b870-41a6-9bcd-598e1c9d34bc Jul 22 11:19:43.940987 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:19:43.940987 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:19:43.940987 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:19:43.940987 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:19:43.940987 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:19:43.942274 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:19:43.942274 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 22 11:19:43.942274 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 22 11:19:43.942274 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume ad33c2ab-3366-4c02-b53b-7c6f2f789506 is already attached to instances: 272976bd-b870-41a6-9bcd-598e1c9d34bc Jul 22 11:19:43.942274 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:19:43.942274 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-17548313-14e9-4c94-9c80-d7fef563ae02 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Returning 400 to user: Invalid volume: volume ad33c2ab-3366-4c02-b53b-7c6f2f789506 is already attached to instances: 272976bd-b870-41a6-9bcd-598e1c9d34bc {{(pid=117884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 22 11:19:43.942274 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-17548313-14e9-4c94-9c80-d7fef563ae02 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "POST /compute/v2.1/servers/272976bd-b870-41a6-9bcd-598e1c9d34bc/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.245618 Jul 22 11:19:43.942274 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 341/689] 10.222.0.20 () {60 vars in 1322 bytes} [Fri Jul 22 11:19:43 2022] POST /compute/v2.1/servers/272976bd-b870-41a6-9bcd-598e1c9d34bc/os-volume_attachments => generated 174 bytes in 248 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 22 11:19:44.045511 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-a6a0400e-23cf-4235-91a2-6eb4cc13c5d8 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:44.047075 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-a6a0400e-23cf-4235-91a2-6eb4cc13c5d8 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 272976bd-b870-41a6-9bcd-598e1c9d34bc] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:44.054729 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a6a0400e-23cf-4235-91a2-6eb4cc13c5d8 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:44.055509 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a6a0400e-23cf-4235-91a2-6eb4cc13c5d8 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:44.056502 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a6a0400e-23cf-4235-91a2-6eb4cc13c5d8 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:44.057166 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a6a0400e-23cf-4235-91a2-6eb4cc13c5d8 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:44.172311 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.objects.instance [None req-a6a0400e-23cf-4235-91a2-6eb4cc13c5d8 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lazy-loading 'services' on Instance uuid 272976bd-b870-41a6-9bcd-598e1c9d34bc {{(pid=117885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 22 11:19:44.314127 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-a6a0400e-23cf-4235-91a2-6eb4cc13c5d8 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "DELETE /compute/v2.1/servers/272976bd-b870-41a6-9bcd-598e1c9d34bc/os-volume_attachments/ad33c2ab-3366-4c02-b53b-7c6f2f789506" status: 202 len: 0 microversion: 2.1 time: 0.273568 Jul 22 11:19:44.320372 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 349/690] 10.222.0.20 () {58 vars in 1415 bytes} [Fri Jul 22 11:19:44 2022] DELETE /compute/v2.1/servers/272976bd-b870-41a6-9bcd-598e1c9d34bc/os-volume_attachments/ad33c2ab-3366-4c02-b53b-7c6f2f789506 => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 22 11:19:44.332373 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-98503369-9eae-4b37-8491-e8ae58e6b63d tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:44.334152 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-98503369-9eae-4b37-8491-e8ae58e6b63d tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 272976bd-b870-41a6-9bcd-598e1c9d34bc] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:44.344168 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-98503369-9eae-4b37-8491-e8ae58e6b63d tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:44.345011 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-98503369-9eae-4b37-8491-e8ae58e6b63d tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:44.346315 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-98503369-9eae-4b37-8491-e8ae58e6b63d tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:44.347435 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-98503369-9eae-4b37-8491-e8ae58e6b63d tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:44.394751 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-98503369-9eae-4b37-8491-e8ae58e6b63d tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/272976bd-b870-41a6-9bcd-598e1c9d34bc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069522 Jul 22 11:19:44.398976 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 342/691] 10.222.0.20 () {58 vars in 1301 bytes} [Fri Jul 22 11:19:44 2022] GET /compute/v2.1/servers/272976bd-b870-41a6-9bcd-598e1c9d34bc/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:19:44.705647 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-3983430f-db46-4576-b524-52225da8f1e1 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:44.707075 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-3983430f-db46-4576-b524-52225da8f1e1 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 6d50352a-fd4f-4ca5-8e13-2519dfbb66a1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:44.718808 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3983430f-db46-4576-b524-52225da8f1e1 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:44.719792 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3983430f-db46-4576-b524-52225da8f1e1 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:44.720906 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3983430f-db46-4576-b524-52225da8f1e1 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:44.721576 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3983430f-db46-4576-b524-52225da8f1e1 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:44.728544 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-f59fd82c-9ea7-44bf-8c1e-616afcb51c46 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:44.729080 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-f59fd82c-9ea7-44bf-8c1e-616afcb51c46 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:44.738936 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f59fd82c-9ea7-44bf-8c1e-616afcb51c46 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:44.739674 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f59fd82c-9ea7-44bf-8c1e-616afcb51c46 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:44.740566 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f59fd82c-9ea7-44bf-8c1e-616afcb51c46 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:44.743522 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f59fd82c-9ea7-44bf-8c1e-616afcb51c46 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:44.744456 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.wsgi [None req-3983430f-db46-4576-b524-52225da8f1e1 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] HTTP exception thrown: Instance 6d50352a-fd4f-4ca5-8e13-2519dfbb66a1 could not be found. Jul 22 11:19:44.747523 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-3983430f-db46-4576-b524-52225da8f1e1 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Request method failure captured: Jul 22 11:19:44.747523 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: request: GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1 HTTP/1.1 Jul 22 11:19:44.747523 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Accept: application/json Jul 22 11:19:44.747523 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Accept-Encoding: identity Jul 22 11:19:44.747523 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Connection: close Jul 22 11:19:44.747523 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Content-Length: 0 Jul 22 11:19:44.747523 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Content-Type: application/json Jul 22 11:19:44.747523 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Host: 10.222.0.20 Jul 22 11:19:44.747523 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Openstack-System-Scope: None Jul 22 11:19:44.747523 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: User-Agent: python-urllib3/1.26.9 Jul 22 11:19:44.747523 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Auth-Token: gAAAAABi2oZ_Qtszk4MNpu9uH6l3EUMK_AOOmV9E0vuS3FH7JkDwedj0MokFDNI6ti-i3aiOV4rP5TlBIaseQX6BcCMnHyQc2puFc3igItuqN6Fa-5lAd9CC5ZoEig99yVdCpczVS8L09dtiY0BgUBiyP4qmW8wj6-arLdMtONe-36WcUI5-aNY Jul 22 11:19:44.747523 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Domain-Id: None Jul 22 11:19:44.747523 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Domain-Name: None Jul 22 11:19:44.747523 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Identity-Status: Confirmed Jul 22 11:19:44.747523 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Is-Admin-Project: True Jul 22 11:19:44.747523 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Project-Domain-Id: default Jul 22 11:19:44.747523 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Project-Domain-Name: Default Jul 22 11:19:44.747523 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Project-Id: 601d12851417478a8b39bbf0c9fcd03d Jul 22 11:19:44.747523 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-821389900 Jul 22 11:19:44.747523 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Role: reader,member Jul 22 11:19:44.747523 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Roles: reader,member Jul 22 11:19:44.748986 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/601d12851417478a8b39bbf0c9fcd03d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_601d12851417478a8b39bbf0c9fcd03d", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/601d12851417478a8b39bbf0c9fcd03d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/601d12851417478a8b39bbf0c9fcd03d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jul 22 11:19:44.748986 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Tenant: tempest-ServerRescueNegativeTestJSON-821389900 Jul 22 11:19:44.748986 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Tenant-Id: 601d12851417478a8b39bbf0c9fcd03d Jul 22 11:19:44.748986 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-821389900 Jul 22 11:19:44.748986 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User: tempest-ServerRescueNegativeTestJSON-821389900-project Jul 22 11:19:44.748986 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User-Domain-Id: default Jul 22 11:19:44.748986 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User-Domain-Name: Default Jul 22 11:19:44.748986 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User-Id: 7c2c0270618240de8fd9290d01a7413a Jul 22 11:19:44.748986 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User-Name: tempest-ServerRescueNegativeTestJSON-821389900-project Jul 22 11:19:44.748986 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: method: > Jul 22 11:19:44.748986 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: exception: Instance 6d50352a-fd4f-4ca5-8e13-2519dfbb66a1 could not be found. Jul 22 11:19:44.748986 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: action_args: {'id': '6d50352a-fd4f-4ca5-8e13-2519dfbb66a1'} Jul 22 11:19:44.749697 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 22 11:19:44.749697 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:19:44.749697 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 22 11:19:44.749697 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 22 11:19:44.749697 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 22 11:19:44.749697 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 22 11:19:44.749697 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 22 11:19:44.749697 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 22 11:19:44.749697 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 22 11:19:44.749697 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 22 11:19:44.749697 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d50352a-fd4f-4ca5-8e13-2519dfbb66a1 could not be found. Jul 22 11:19:44.749697 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:19:44.749697 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:19:44.749697 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:19:44.749697 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:19:44.749697 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:19:44.749697 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:19:44.749697 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 22 11:19:44.749697 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 22 11:19:44.749697 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 22 11:19:44.750818 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 22 11:19:44.750818 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 22 11:19:44.750818 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 22 11:19:44.750818 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 22 11:19:44.750818 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 22 11:19:44.750818 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 22 11:19:44.750818 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 22 11:19:44.750818 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d50352a-fd4f-4ca5-8e13-2519dfbb66a1 could not be found. Jul 22 11:19:44.750818 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:19:44.750818 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:19:44.750818 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:19:44.750818 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:19:44.750818 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:19:44.750818 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:19:44.750818 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 22 11:19:44.750818 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 22 11:19:44.750818 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d50352a-fd4f-4ca5-8e13-2519dfbb66a1 could not be found. Jul 22 11:19:44.750818 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:19:44.754889 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-3983430f-db46-4576-b524-52225da8f1e1 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Returning 404 to user: Instance 6d50352a-fd4f-4ca5-8e13-2519dfbb66a1 could not be found. {{(pid=117885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 22 11:19:44.756751 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-3983430f-db46-4576-b524-52225da8f1e1 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1" status: 404 len: 111 microversion: 2.1 time: 0.055126 Jul 22 11:19:44.758834 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 350/692] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:19:44 2022] GET /compute/v2.1/servers/6d50352a-fd4f-4ca5-8e13-2519dfbb66a1 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 22 11:19:44.767602 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-5fa414e8-e833-41bc-95f2-164cd870393c tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '.version_select at 0x7f8449922790>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:44.795710 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-f59fd82c-9ea7-44bf-8c1e-616afcb51c46 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.072346 Jul 22 11:19:44.796625 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 343/693] 10.222.0.20 () {60 vars in 1342 bytes} [Fri Jul 22 11:19:44 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54/os-volume_attachments => generated 25 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:19:44.809751 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-5fa414e8-e833-41bc-95f2-164cd870393c tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-724097415" status: 202 len: 0 microversion: 2.1 time: 0.045749 Jul 22 11:19:44.810552 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 351/694] 10.222.0.20 () {58 vars in 1217 bytes} [Fri Jul 22 11:19:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-724097415 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 22 11:19:44.901843 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-d7bfb7ea-b764-4ac9-aa8e-ba04deccb8f1 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:44.902488 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-d7bfb7ea-b764-4ac9-aa8e-ba04deccb8f1 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:44.913647 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-d7bfb7ea-b764-4ac9-aa8e-ba04deccb8f1 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:44.915799 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-d7bfb7ea-b764-4ac9-aa8e-ba04deccb8f1 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:44.916792 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-d7bfb7ea-b764-4ac9-aa8e-ba04deccb8f1 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:44.921900 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-d7bfb7ea-b764-4ac9-aa8e-ba04deccb8f1 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:44.989710 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-d7bfb7ea-b764-4ac9-aa8e-ba04deccb8f1 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Going to try to terminate instance {{(pid=117884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 22 11:19:45.138353 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-d7bfb7ea-b764-4ac9-aa8e-ba04deccb8f1 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54" status: 204 len: 0 microversion: 2.20 time: 0.238901 Jul 22 11:19:45.144149 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 344/695] 10.222.0.20 () {60 vars in 1279 bytes} [Fri Jul 22 11:19:44 2022] DELETE /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 22 11:19:45.150257 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-895e9777-c130-4e39-b7e7-6f694e44481b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:45.150842 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-895e9777-c130-4e39-b7e7-6f694e44481b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:45.158871 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-895e9777-c130-4e39-b7e7-6f694e44481b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:45.159398 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-895e9777-c130-4e39-b7e7-6f694e44481b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:45.160153 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-895e9777-c130-4e39-b7e7-6f694e44481b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:45.160760 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-895e9777-c130-4e39-b7e7-6f694e44481b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:45.414186 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-895e9777-c130-4e39-b7e7-6f694e44481b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:19:45.423664 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-511ecd81-902c-44e0-ab0f-05a0ebe8902d tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:45.424778 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-511ecd81-902c-44e0-ab0f-05a0ebe8902d tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 272976bd-b870-41a6-9bcd-598e1c9d34bc] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:45.425585 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:19:45.439766 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-895e9777-c130-4e39-b7e7-6f694e44481b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:19:45.445278 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-895e9777-c130-4e39-b7e7-6f694e44481b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:19:45.446375 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-511ecd81-902c-44e0-ab0f-05a0ebe8902d tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:45.446999 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-511ecd81-902c-44e0-ab0f-05a0ebe8902d tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:45.448189 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-511ecd81-902c-44e0-ab0f-05a0ebe8902d tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:45.449941 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-895e9777-c130-4e39-b7e7-6f694e44481b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54" status: 200 len: 1724 microversion: 2.20 time: 0.304454 Jul 22 11:19:45.450596 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-511ecd81-902c-44e0-ab0f-05a0ebe8902d tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:45.453172 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 352/696] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:19:45 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 => generated 1724 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:19:45.481801 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG dbcounter [-] [117884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:19:45.496205 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-511ecd81-902c-44e0-ab0f-05a0ebe8902d tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/272976bd-b870-41a6-9bcd-598e1c9d34bc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092963 Jul 22 11:19:45.497167 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 345/697] 10.222.0.20 () {58 vars in 1301 bytes} [Fri Jul 22 11:19:45 2022] GET /compute/v2.1/servers/272976bd-b870-41a6-9bcd-598e1c9d34bc/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:19:46.142849 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-fbcf14cf-c9db-4690-be13-26b2b56897ed tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-824230109", "imageRef": "1a6c3cb4-9f56-44c6-aa68-01000df27209", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a5e21a67-be78-4f6f-a34d-4e6e3696796e"}], "security_groups": [{"name": "tempest-securitygroup--1176089191"}], "key_name": "tempest-keypair-848028287", "user_data": "}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:19:46.302614 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.network.neutron [None req-fbcf14cf-c9db-4690-be13-26b2b56897ed tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] validate_networks() for [('a5e21a67-be78-4f6f-a34d-4e6e3696796e', None, None, None, None, None)] {{(pid=117885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 22 11:19:46.474955 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-20fa9756-ee24-4484-b2fc-8363da64a6b7 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:46.476414 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-20fa9756-ee24-4484-b2fc-8363da64a6b7 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:46.485848 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-20fa9756-ee24-4484-b2fc-8363da64a6b7 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:46.486711 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-20fa9756-ee24-4484-b2fc-8363da64a6b7 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:46.487374 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-20fa9756-ee24-4484-b2fc-8363da64a6b7 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:46.488087 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-20fa9756-ee24-4484-b2fc-8363da64a6b7 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:46.859225 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-fbcf14cf-c9db-4690-be13-26b2b56897ed tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Flavor limits 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 22 11:19:46.859694 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-fbcf14cf-c9db-4690-be13-26b2b56897ed tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Image limits 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 22 11:19:46.860179 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-fbcf14cf-c9db-4690-be13-26b2b56897ed tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Flavor pref 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 22 11:19:46.860573 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-fbcf14cf-c9db-4690-be13-26b2b56897ed tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Image pref 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 22 11:19:46.861099 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-fbcf14cf-c9db-4690-be13-26b2b56897ed tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 22 11:19:46.865523 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:19:46.874614 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fbcf14cf-c9db-4690-be13-26b2b56897ed tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:46.875059 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fbcf14cf-c9db-4690-be13-26b2b56897ed tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:46.875918 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fbcf14cf-c9db-4690-be13-26b2b56897ed tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:46.876411 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fbcf14cf-c9db-4690-be13-26b2b56897ed tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:46.901052 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-fbcf14cf-c9db-4690-be13-26b2b56897ed tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Getting quotas for project f50a15db11214fb5a637fb400dcd928f. Resources: {'instances', 'cores', 'ram'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 22 11:19:46.906160 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-fbcf14cf-c9db-4690-be13-26b2b56897ed tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Getting quotas for user da75b78b267f47e8aaaafb41e3acb61a and project f50a15db11214fb5a637fb400dcd928f. Resources: {'instances', 'cores', 'ram'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 22 11:19:46.931515 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-fbcf14cf-c9db-4690-be13-26b2b56897ed tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Going to run 1 instances... {{(pid=117885) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 22 11:19:46.934247 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-fbcf14cf-c9db-4690-be13-26b2b56897ed tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: edc7a08a-180f-4907-9f8d-9d14bd9cf10c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1a6c3cb4-9f56-44c6-aa68-01000df27209',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 22 11:19:46.996434 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-fbcf14cf-c9db-4690-be13-26b2b56897ed tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.859647 Jul 22 11:19:46.997652 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 353/698] 10.222.0.20 () {60 vars in 1146 bytes} [Fri Jul 22 11:19:46 2022] POST /compute/v2.1/servers => generated 402 bytes in 861 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 22 11:19:47.004019 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-f85cb3f6-624a-4c45-9cc7-861483c99a0c tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:47.005458 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-f85cb3f6-624a-4c45-9cc7-861483c99a0c tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 272976bd-b870-41a6-9bcd-598e1c9d34bc] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:47.015174 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f85cb3f6-624a-4c45-9cc7-861483c99a0c tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:47.018052 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f85cb3f6-624a-4c45-9cc7-861483c99a0c tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:47.019495 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f85cb3f6-624a-4c45-9cc7-861483c99a0c tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:47.020264 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f85cb3f6-624a-4c45-9cc7-861483c99a0c tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:47.055683 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-20fa9756-ee24-4484-b2fc-8363da64a6b7 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:19:47.066086 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-20fa9756-ee24-4484-b2fc-8363da64a6b7 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:19:47.068953 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-20fa9756-ee24-4484-b2fc-8363da64a6b7 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:19:47.069472 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-f85cb3f6-624a-4c45-9cc7-861483c99a0c tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/272976bd-b870-41a6-9bcd-598e1c9d34bc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.070518 Jul 22 11:19:47.070513 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 354/699] 10.222.0.20 () {58 vars in 1301 bytes} [Fri Jul 22 11:19:46 2022] GET /compute/v2.1/servers/272976bd-b870-41a6-9bcd-598e1c9d34bc/os-volume_attachments => generated 25 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 22 11:19:47.071017 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-20fa9756-ee24-4484-b2fc-8363da64a6b7 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54" status: 200 len: 1724 microversion: 2.20 time: 0.603256 Jul 22 11:19:47.075687 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-87977f33-4f83-4cc2-a8af-bf0cd096b8ff tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:47.076566 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-87977f33-4f83-4cc2-a8af-bf0cd096b8ff tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: edc7a08a-180f-4907-9f8d-9d14bd9cf10c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:47.082477 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 346/700] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:19:46 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 => generated 1724 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:19:47.166144 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-87977f33-4f83-4cc2-a8af-bf0cd096b8ff tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:19:47.166624 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-86532bf4-c3f0-4100-8e95-4cad38ab042a tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:47.168123 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-86532bf4-c3f0-4100-8e95-4cad38ab042a tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 272976bd-b870-41a6-9bcd-598e1c9d34bc] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:47.175402 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-87977f33-4f83-4cc2-a8af-bf0cd096b8ff tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/edc7a08a-180f-4907-9f8d-9d14bd9cf10c" status: 200 len: 1236 microversion: 2.1 time: 0.102960 Jul 22 11:19:47.176004 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 355/701] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:19:47 2022] GET /compute/v2.1/servers/edc7a08a-180f-4907-9f8d-9d14bd9cf10c => generated 1236 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:19:47.183314 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-86532bf4-c3f0-4100-8e95-4cad38ab042a tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:47.198461 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-86532bf4-c3f0-4100-8e95-4cad38ab042a tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:47.199404 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-86532bf4-c3f0-4100-8e95-4cad38ab042a tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:47.200124 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-86532bf4-c3f0-4100-8e95-4cad38ab042a tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:47.240054 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-86532bf4-c3f0-4100-8e95-4cad38ab042a tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 272976bd-b870-41a6-9bcd-598e1c9d34bc] Going to try to terminate instance {{(pid=117884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 22 11:19:47.366757 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-86532bf4-c3f0-4100-8e95-4cad38ab042a tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "DELETE /compute/v2.1/servers/272976bd-b870-41a6-9bcd-598e1c9d34bc" status: 204 len: 0 microversion: 2.1 time: 0.216497 Jul 22 11:19:47.372294 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 347/702] 10.222.0.20 () {58 vars in 1238 bytes} [Fri Jul 22 11:19:47 2022] DELETE /compute/v2.1/servers/272976bd-b870-41a6-9bcd-598e1c9d34bc => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 22 11:19:47.381329 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-a2dd055c-8ac4-45aa-92ee-bbd88f9e47db tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:47.381615 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-a2dd055c-8ac4-45aa-92ee-bbd88f9e47db tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 272976bd-b870-41a6-9bcd-598e1c9d34bc] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:47.390635 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a2dd055c-8ac4-45aa-92ee-bbd88f9e47db tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:47.391083 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a2dd055c-8ac4-45aa-92ee-bbd88f9e47db tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:47.391889 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a2dd055c-8ac4-45aa-92ee-bbd88f9e47db tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:47.393163 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a2dd055c-8ac4-45aa-92ee-bbd88f9e47db tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:47.586532 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-a2dd055c-8ac4-45aa-92ee-bbd88f9e47db tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:19:47.599006 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-a2dd055c-8ac4-45aa-92ee-bbd88f9e47db tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/272976bd-b870-41a6-9bcd-598e1c9d34bc" status: 200 len: 1680 microversion: 2.1 time: 0.221437 Jul 22 11:19:47.600887 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 356/703] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:19:47 2022] GET /compute/v2.1/servers/272976bd-b870-41a6-9bcd-598e1c9d34bc => generated 1680 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:19:48.092764 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-f06b0758-39a8-4aa3-9471-e3770297d5d6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:48.093461 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-f06b0758-39a8-4aa3-9471-e3770297d5d6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:48.100390 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f06b0758-39a8-4aa3-9471-e3770297d5d6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:48.100838 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f06b0758-39a8-4aa3-9471-e3770297d5d6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:48.101641 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f06b0758-39a8-4aa3-9471-e3770297d5d6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:48.102077 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f06b0758-39a8-4aa3-9471-e3770297d5d6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:48.194331 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-60cf785f-1075-4350-bab4-cb7cad46a3b8 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:48.194957 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-60cf785f-1075-4350-bab4-cb7cad46a3b8 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: edc7a08a-180f-4907-9f8d-9d14bd9cf10c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:48.202246 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-60cf785f-1075-4350-bab4-cb7cad46a3b8 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:48.202728 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-60cf785f-1075-4350-bab4-cb7cad46a3b8 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:48.203531 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-60cf785f-1075-4350-bab4-cb7cad46a3b8 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:48.203968 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-60cf785f-1075-4350-bab4-cb7cad46a3b8 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:48.247817 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-f06b0758-39a8-4aa3-9471-e3770297d5d6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:19:48.258335 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-f06b0758-39a8-4aa3-9471-e3770297d5d6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:19:48.260146 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-f06b0758-39a8-4aa3-9471-e3770297d5d6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:19:48.261591 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-f06b0758-39a8-4aa3-9471-e3770297d5d6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54" status: 200 len: 1656 microversion: 2.20 time: 0.173496 Jul 22 11:19:48.274119 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 348/704] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:19:48 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 => generated 1656 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:19:48.306398 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-60cf785f-1075-4350-bab4-cb7cad46a3b8 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:19:48.316581 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-60cf785f-1075-4350-bab4-cb7cad46a3b8 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/edc7a08a-180f-4907-9f8d-9d14bd9cf10c" status: 200 len: 1240 microversion: 2.1 time: 0.127003 Jul 22 11:19:48.319425 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 357/705] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:19:48 2022] GET /compute/v2.1/servers/edc7a08a-180f-4907-9f8d-9d14bd9cf10c => generated 1240 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:19:48.411444 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-c0ecfba6-13ab-4bfa-9afd-16a676c87d55 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:48.412392 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-c0ecfba6-13ab-4bfa-9afd-16a676c87d55 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 3108d9e0-3b2d-402a-aaab-c313c30e7900] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:48.418486 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c0ecfba6-13ab-4bfa-9afd-16a676c87d55 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:48.419154 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c0ecfba6-13ab-4bfa-9afd-16a676c87d55 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:48.420154 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c0ecfba6-13ab-4bfa-9afd-16a676c87d55 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:48.420905 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c0ecfba6-13ab-4bfa-9afd-16a676c87d55 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:48.456316 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-c0ecfba6-13ab-4bfa-9afd-16a676c87d55 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 3108d9e0-3b2d-402a-aaab-c313c30e7900] Going to try to terminate instance {{(pid=117884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 22 11:19:48.572301 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-82cd4729-84b7-4f78-a3e4-5c7aace1fdb8 req-5f5c1ae9-4576-4b83-bcd1-19d4dd2fc68d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f27dab8-c005-4dd0-b262-542deb60dd54", "name": "network-vif-deleted", "tag": "019d06a1-2c6e-4ebb-b1f0-a080fc8a2fef"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:19:48.588111 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-82cd4729-84b7-4f78-a3e4-5c7aace1fdb8 req-5f5c1ae9-4576-4b83-bcd1-19d4dd2fc68d service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:48.588550 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-82cd4729-84b7-4f78-a3e4-5c7aace1fdb8 req-5f5c1ae9-4576-4b83-bcd1-19d4dd2fc68d service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:48.612333 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG dbcounter [-] [117884] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:UPDATE=3 {{(pid=117884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:19:48.616780 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-82cd4729-84b7-4f78-a3e4-5c7aace1fdb8 req-5f5c1ae9-4576-4b83-bcd1-19d4dd2fc68d service nova] Creating event network-vif-deleted:019d06a1-2c6e-4ebb-b1f0-a080fc8a2fef for instance 1f27dab8-c005-4dd0-b262-542deb60dd54 on hv-cinder-84890 Jul 22 11:19:48.626043 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-c0ecfba6-13ab-4bfa-9afd-16a676c87d55 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900" status: 204 len: 0 microversion: 2.1 time: 0.217154 Jul 22 11:19:48.632310 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 349/706] 10.222.0.20 () {58 vars in 1238 bytes} [Fri Jul 22 11:19:48 2022] DELETE /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 22 11:19:48.632472 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-82cd4729-84b7-4f78-a3e4-5c7aace1fdb8 req-5f5c1ae9-4576-4b83-bcd1-19d4dd2fc68d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064359 Jul 22 11:19:48.633414 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 358/707] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 22 11:19:48.642483 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-443e9bbb-c445-4622-8051-7972be115e0a tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:48.642938 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-e0465c0e-9aa7-4d00-8ea3-fd63bc9a04f3 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:48.644140 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-e0465c0e-9aa7-4d00-8ea3-fd63bc9a04f3 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 272976bd-b870-41a6-9bcd-598e1c9d34bc] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:48.649482 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-443e9bbb-c445-4622-8051-7972be115e0a tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 3108d9e0-3b2d-402a-aaab-c313c30e7900] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:48.653087 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-e0465c0e-9aa7-4d00-8ea3-fd63bc9a04f3 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:48.653836 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-e0465c0e-9aa7-4d00-8ea3-fd63bc9a04f3 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:48.655043 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-e0465c0e-9aa7-4d00-8ea3-fd63bc9a04f3 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:48.655776 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-e0465c0e-9aa7-4d00-8ea3-fd63bc9a04f3 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:48.660172 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-443e9bbb-c445-4622-8051-7972be115e0a tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:48.660984 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-443e9bbb-c445-4622-8051-7972be115e0a tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:48.662494 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-443e9bbb-c445-4622-8051-7972be115e0a tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:48.662985 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-443e9bbb-c445-4622-8051-7972be115e0a tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:48.962977 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-e0465c0e-9aa7-4d00-8ea3-fd63bc9a04f3 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:19:48.973195 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-e0465c0e-9aa7-4d00-8ea3-fd63bc9a04f3 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/272976bd-b870-41a6-9bcd-598e1c9d34bc" status: 200 len: 1680 microversion: 2.1 time: 0.335512 Jul 22 11:19:48.973809 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 350/708] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:19:48 2022] GET /compute/v2.1/servers/272976bd-b870-41a6-9bcd-598e1c9d34bc => generated 1680 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:19:49.018612 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-443e9bbb-c445-4622-8051-7972be115e0a tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:19:49.028436 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-443e9bbb-c445-4622-8051-7972be115e0a tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900" status: 200 len: 1508 microversion: 2.1 time: 0.393626 Jul 22 11:19:49.029787 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 359/709] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:19:48 2022] GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900 => generated 1508 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:19:49.285891 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-c6784ea4-b704-4ea9-bc91-d2164e6d65c5 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:49.290164 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-c6784ea4-b704-4ea9-bc91-d2164e6d65c5 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:49.301531 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c6784ea4-b704-4ea9-bc91-d2164e6d65c5 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:49.302240 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c6784ea4-b704-4ea9-bc91-d2164e6d65c5 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:49.303221 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c6784ea4-b704-4ea9-bc91-d2164e6d65c5 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:49.303838 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c6784ea4-b704-4ea9-bc91-d2164e6d65c5 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:49.339819 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-921792b6-1484-4c0b-a5ee-e6e1ab7fe43c tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:49.343424 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-921792b6-1484-4c0b-a5ee-e6e1ab7fe43c tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: edc7a08a-180f-4907-9f8d-9d14bd9cf10c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:49.370543 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-c6784ea4-b704-4ea9-bc91-d2164e6d65c5 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:19:49.379148 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-c6784ea4-b704-4ea9-bc91-d2164e6d65c5 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:19:49.382315 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-c6784ea4-b704-4ea9-bc91-d2164e6d65c5 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:19:49.382467 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-921792b6-1484-4c0b-a5ee-e6e1ab7fe43c tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:49.383433 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-921792b6-1484-4c0b-a5ee-e6e1ab7fe43c tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:49.384024 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-c6784ea4-b704-4ea9-bc91-d2164e6d65c5 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54" status: 200 len: 1367 microversion: 2.20 time: 0.106361 Jul 22 11:19:49.385127 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 351/710] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:19:49 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 => generated 1367 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:19:49.386771 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-921792b6-1484-4c0b-a5ee-e6e1ab7fe43c tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:49.400419 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-921792b6-1484-4c0b-a5ee-e6e1ab7fe43c tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:49.508850 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-921792b6-1484-4c0b-a5ee-e6e1ab7fe43c tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:19:49.519349 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-921792b6-1484-4c0b-a5ee-e6e1ab7fe43c tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/edc7a08a-180f-4907-9f8d-9d14bd9cf10c" status: 200 len: 1240 microversion: 2.1 time: 0.187367 Jul 22 11:19:49.520521 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 360/711] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:19:49 2022] GET /compute/v2.1/servers/edc7a08a-180f-4907-9f8d-9d14bd9cf10c => generated 1240 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:19:49.991942 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-a3ccceea-d5d6-470c-ba51-b73ea8a36ee9 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:49.992642 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-a3ccceea-d5d6-470c-ba51-b73ea8a36ee9 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 272976bd-b870-41a6-9bcd-598e1c9d34bc] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:49.998890 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-a3ccceea-d5d6-470c-ba51-b73ea8a36ee9 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:49.999466 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-a3ccceea-d5d6-470c-ba51-b73ea8a36ee9 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:50.000305 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-a3ccceea-d5d6-470c-ba51-b73ea8a36ee9 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:50.000737 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-a3ccceea-d5d6-470c-ba51-b73ea8a36ee9 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:50.046621 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-d352c676-3bff-4113-bbd5-1fd2b56c1f27 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:50.047523 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-d352c676-3bff-4113-bbd5-1fd2b56c1f27 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 3108d9e0-3b2d-402a-aaab-c313c30e7900] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:50.054865 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d352c676-3bff-4113-bbd5-1fd2b56c1f27 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:50.057658 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d352c676-3bff-4113-bbd5-1fd2b56c1f27 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:50.058712 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d352c676-3bff-4113-bbd5-1fd2b56c1f27 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:50.059359 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d352c676-3bff-4113-bbd5-1fd2b56c1f27 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:50.170337 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-a3ccceea-d5d6-470c-ba51-b73ea8a36ee9 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:19:50.178474 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-a3ccceea-d5d6-470c-ba51-b73ea8a36ee9 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/272976bd-b870-41a6-9bcd-598e1c9d34bc" status: 200 len: 1680 microversion: 2.1 time: 0.190630 Jul 22 11:19:50.179056 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 352/712] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:19:49 2022] GET /compute/v2.1/servers/272976bd-b870-41a6-9bcd-598e1c9d34bc => generated 1680 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:19:50.231364 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-d352c676-3bff-4113-bbd5-1fd2b56c1f27 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:19:50.239219 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-d352c676-3bff-4113-bbd5-1fd2b56c1f27 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900" status: 200 len: 1508 microversion: 2.1 time: 0.196559 Jul 22 11:19:50.240650 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 361/713] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:19:50 2022] GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900 => generated 1508 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:19:50.408155 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-e5e911dc-a675-4c2a-a8ce-9e759fe1d0d9 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:50.408155 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-e5e911dc-a675-4c2a-a8ce-9e759fe1d0d9 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:50.413103 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-e5e911dc-a675-4c2a-a8ce-9e759fe1d0d9 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:50.413668 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-e5e911dc-a675-4c2a-a8ce-9e759fe1d0d9 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:50.415706 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-e5e911dc-a675-4c2a-a8ce-9e759fe1d0d9 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:50.415706 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-e5e911dc-a675-4c2a-a8ce-9e759fe1d0d9 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:50.498632 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-e5e911dc-a675-4c2a-a8ce-9e759fe1d0d9 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:19:50.513739 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-e5e911dc-a675-4c2a-a8ce-9e759fe1d0d9 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:19:50.515435 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-e5e911dc-a675-4c2a-a8ce-9e759fe1d0d9 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:19:50.516677 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-e5e911dc-a675-4c2a-a8ce-9e759fe1d0d9 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54" status: 200 len: 1367 microversion: 2.20 time: 0.118259 Jul 22 11:19:50.518079 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 353/714] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:19:50 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 => generated 1367 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:19:50.540597 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-a508107a-e040-4995-ab3c-b0741cfa0ca8 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:50.541373 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-a508107a-e040-4995-ab3c-b0741cfa0ca8 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: edc7a08a-180f-4907-9f8d-9d14bd9cf10c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:50.549805 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a508107a-e040-4995-ab3c-b0741cfa0ca8 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:50.550459 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a508107a-e040-4995-ab3c-b0741cfa0ca8 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:50.551464 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a508107a-e040-4995-ab3c-b0741cfa0ca8 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:50.552124 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a508107a-e040-4995-ab3c-b0741cfa0ca8 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:50.632277 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-a508107a-e040-4995-ab3c-b0741cfa0ca8 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:19:50.640020 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-a508107a-e040-4995-ab3c-b0741cfa0ca8 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/edc7a08a-180f-4907-9f8d-9d14bd9cf10c" status: 200 len: 1232 microversion: 2.1 time: 0.104835 Jul 22 11:19:50.640605 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 362/715] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:19:50 2022] GET /compute/v2.1/servers/edc7a08a-180f-4907-9f8d-9d14bd9cf10c => generated 1232 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:19:51.202067 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-e9715646-1690-4975-989d-fb420144bb1c tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:51.203142 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-e9715646-1690-4975-989d-fb420144bb1c tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 272976bd-b870-41a6-9bcd-598e1c9d34bc] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:51.210417 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-e9715646-1690-4975-989d-fb420144bb1c tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:51.211321 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-e9715646-1690-4975-989d-fb420144bb1c tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:51.212348 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-e9715646-1690-4975-989d-fb420144bb1c tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:51.213002 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-e9715646-1690-4975-989d-fb420144bb1c tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:51.257848 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-b47f6f47-927d-43f6-a62e-b292f106ec44 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:51.258754 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-b47f6f47-927d-43f6-a62e-b292f106ec44 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 3108d9e0-3b2d-402a-aaab-c313c30e7900] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:51.265505 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b47f6f47-927d-43f6-a62e-b292f106ec44 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:51.266226 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b47f6f47-927d-43f6-a62e-b292f106ec44 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:51.267175 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b47f6f47-927d-43f6-a62e-b292f106ec44 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:51.267860 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b47f6f47-927d-43f6-a62e-b292f106ec44 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:51.540972 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-e9715646-1690-4975-989d-fb420144bb1c tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:19:51.555362 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-e9715646-1690-4975-989d-fb420144bb1c tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/272976bd-b870-41a6-9bcd-598e1c9d34bc" status: 200 len: 1680 microversion: 2.1 time: 0.357005 Jul 22 11:19:51.566376 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 354/716] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:19:51 2022] GET /compute/v2.1/servers/272976bd-b870-41a6-9bcd-598e1c9d34bc => generated 1680 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:19:51.570598 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-b47f6f47-927d-43f6-a62e-b292f106ec44 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:19:51.574100 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-9088ab39-a264-4eed-9a27-42ae57ce4bd0 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:51.574958 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-9088ab39-a264-4eed-9a27-42ae57ce4bd0 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:51.582652 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-b47f6f47-927d-43f6-a62e-b292f106ec44 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900" status: 200 len: 1508 microversion: 2.1 time: 0.328838 Jul 22 11:19:51.583891 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 363/717] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:19:51 2022] GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900 => generated 1508 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:19:51.594564 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-9088ab39-a264-4eed-9a27-42ae57ce4bd0 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:51.595416 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-9088ab39-a264-4eed-9a27-42ae57ce4bd0 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:51.596456 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-9088ab39-a264-4eed-9a27-42ae57ce4bd0 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:51.597084 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-9088ab39-a264-4eed-9a27-42ae57ce4bd0 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:51.619088 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.wsgi [None req-9088ab39-a264-4eed-9a27-42ae57ce4bd0 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] HTTP exception thrown: Instance 1f27dab8-c005-4dd0-b262-542deb60dd54 could not be found. Jul 22 11:19:51.620835 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-9088ab39-a264-4eed-9a27-42ae57ce4bd0 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Request method failure captured: Jul 22 11:19:51.620835 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: request: GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 HTTP/1.1 Jul 22 11:19:51.620835 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Accept: application/json Jul 22 11:19:51.620835 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Accept-Encoding: identity Jul 22 11:19:51.620835 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Connection: close Jul 22 11:19:51.620835 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Content-Length: 0 Jul 22 11:19:51.620835 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Content-Type: application/json Jul 22 11:19:51.620835 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Host: 10.222.0.20 Jul 22 11:19:51.620835 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Openstack-System-Scope: None Jul 22 11:19:51.620835 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: User-Agent: python-urllib3/1.26.9 Jul 22 11:19:51.620835 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Auth-Token: gAAAAABi2obkhLpwbPo8iCLViqoRP4IeqdCwt1UHm93yMDr_ne3LjF1_ecp2T8W8QtG5lp9yZAFjJojTvSrVywgsc-2Op4HesUZh2kcKDqDesLMRM36Pis_iVc7Es_mx9guoLwx8h0hAfY2dCZtZsS0tza2GEjm1Ji4suovm5RuuKLKZcM8dy5k Jul 22 11:19:51.620835 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Domain-Id: None Jul 22 11:19:51.620835 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Domain-Name: None Jul 22 11:19:51.620835 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Identity-Status: Confirmed Jul 22 11:19:51.620835 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Is-Admin-Project: True Jul 22 11:19:51.620835 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Openstack-Nova-Api-Version: 2.20 Jul 22 11:19:51.620835 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Domain-Id: default Jul 22 11:19:51.620835 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Domain-Name: Default Jul 22 11:19:51.620835 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Id: b745569c01e04aa18f5494b0856bc3d1 Jul 22 11:19:51.620835 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-101294574 Jul 22 11:19:51.620835 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Role: reader,member Jul 22 11:19:51.620835 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Roles: reader,member Jul 22 11:19:51.622179 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b745569c01e04aa18f5494b0856bc3d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b745569c01e04aa18f5494b0856bc3d1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b745569c01e04aa18f5494b0856bc3d1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b745569c01e04aa18f5494b0856bc3d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jul 22 11:19:51.622179 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant: tempest-AttachVolumeShelveTestJSON-101294574 Jul 22 11:19:51.622179 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant-Id: b745569c01e04aa18f5494b0856bc3d1 Jul 22 11:19:51.622179 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-101294574 Jul 22 11:19:51.622179 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User: tempest-AttachVolumeShelveTestJSON-101294574-project Jul 22 11:19:51.622179 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Domain-Id: default Jul 22 11:19:51.622179 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Domain-Name: Default Jul 22 11:19:51.622179 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Id: 99798aca08904bc787f5d0afee8d0ac7 Jul 22 11:19:51.622179 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Name: tempest-AttachVolumeShelveTestJSON-101294574-project Jul 22 11:19:51.622179 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: method: > Jul 22 11:19:51.622179 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: exception: Instance 1f27dab8-c005-4dd0-b262-542deb60dd54 could not be found. Jul 22 11:19:51.622179 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: action_args: {'id': '1f27dab8-c005-4dd0-b262-542deb60dd54'} Jul 22 11:19:51.622990 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 22 11:19:51.622990 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:19:51.622990 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 22 11:19:51.622990 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 22 11:19:51.622990 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 22 11:19:51.622990 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 22 11:19:51.622990 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 22 11:19:51.622990 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 22 11:19:51.622990 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 22 11:19:51.622990 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 22 11:19:51.622990 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f27dab8-c005-4dd0-b262-542deb60dd54 could not be found. Jul 22 11:19:51.622990 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:19:51.622990 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:19:51.622990 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:19:51.622990 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:19:51.622990 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:19:51.622990 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:19:51.622990 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 22 11:19:51.622990 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 22 11:19:51.622990 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 22 11:19:51.624160 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 22 11:19:51.624160 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 22 11:19:51.624160 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 22 11:19:51.624160 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 22 11:19:51.624160 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 22 11:19:51.624160 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 22 11:19:51.624160 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 22 11:19:51.624160 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f27dab8-c005-4dd0-b262-542deb60dd54 could not be found. Jul 22 11:19:51.624160 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:19:51.624160 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:19:51.624160 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:19:51.624160 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:19:51.624160 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:19:51.624160 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:19:51.624160 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 22 11:19:51.624160 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 22 11:19:51.624160 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f27dab8-c005-4dd0-b262-542deb60dd54 could not be found. Jul 22 11:19:51.624160 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:19:51.625212 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-9088ab39-a264-4eed-9a27-42ae57ce4bd0 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Returning 404 to user: Instance 1f27dab8-c005-4dd0-b262-542deb60dd54 could not be found. {{(pid=117884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 22 11:19:51.625212 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-9088ab39-a264-4eed-9a27-42ae57ce4bd0 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54" status: 404 len: 111 microversion: 2.20 time: 0.054121 Jul 22 11:19:51.625212 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 355/718] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:19:51 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 22 11:19:51.632999 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-67212e80-d2a8-45ac-833d-f127e2dc86f0 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '.version_select at 0x7f8449a14160>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:51.654311 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-67212e80-d2a8-45ac-833d-f127e2dc86f0 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1959724869" status: 204 len: 0 microversion: 2.20 time: 0.026013 Jul 22 11:19:51.655236 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 364/719] 10.222.0.20 () {60 vars in 1261 bytes} [Fri Jul 22 11:19:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1959724869 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 22 11:19:51.662965 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-fdd12b62-6921-4266-bde5-3c36b08e794a tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:51.664028 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-fdd12b62-6921-4266-bde5-3c36b08e794a tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: edc7a08a-180f-4907-9f8d-9d14bd9cf10c] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:51.671169 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-fdd12b62-6921-4266-bde5-3c36b08e794a tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:51.671799 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-fdd12b62-6921-4266-bde5-3c36b08e794a tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:51.672682 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-fdd12b62-6921-4266-bde5-3c36b08e794a tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:51.673225 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-fdd12b62-6921-4266-bde5-3c36b08e794a tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:51.764905 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-fdd12b62-6921-4266-bde5-3c36b08e794a tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:19:51.778364 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-fdd12b62-6921-4266-bde5-3c36b08e794a tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/edc7a08a-180f-4907-9f8d-9d14bd9cf10c" status: 200 len: 1294 microversion: 2.1 time: 0.123414 Jul 22 11:19:51.780254 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 356/720] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:19:51 2022] GET /compute/v2.1/servers/edc7a08a-180f-4907-9f8d-9d14bd9cf10c => generated 1294 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:19:51.921588 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-a36dd858-a81a-4d63-9c63-eb7cebe73599 req-c81cb946-7b5e-48c6-984a-616354b57e18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3108d9e0-3b2d-402a-aaab-c313c30e7900", "name": "network-vif-deleted", "tag": "f7e02999-84b1-4561-a0b0-1237dc6412bb"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:19:51.936185 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-a36dd858-a81a-4d63-9c63-eb7cebe73599 req-c81cb946-7b5e-48c6-984a-616354b57e18 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:51.937180 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-a36dd858-a81a-4d63-9c63-eb7cebe73599 req-c81cb946-7b5e-48c6-984a-616354b57e18 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:51.961438 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-a36dd858-a81a-4d63-9c63-eb7cebe73599 req-c81cb946-7b5e-48c6-984a-616354b57e18 service nova] Creating event network-vif-deleted:f7e02999-84b1-4561-a0b0-1237dc6412bb for instance 3108d9e0-3b2d-402a-aaab-c313c30e7900 on hv-cinder-84890 Jul 22 11:19:51.968049 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-a36dd858-a81a-4d63-9c63-eb7cebe73599 req-c81cb946-7b5e-48c6-984a-616354b57e18 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049839 Jul 22 11:19:51.969190 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 365/721] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:19:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 22 11:19:52.578956 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-7be20170-9869-424a-a253-5f310621c73f tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:52.579645 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-7be20170-9869-424a-a253-5f310621c73f tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 272976bd-b870-41a6-9bcd-598e1c9d34bc] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:52.604291 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-421b35eb-aaf9-4b8c-8546-ba392a8d6614 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:52.605752 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-7be20170-9869-424a-a253-5f310621c73f tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:52.606197 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-7be20170-9869-424a-a253-5f310621c73f tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:52.607275 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-7be20170-9869-424a-a253-5f310621c73f tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:52.607420 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-421b35eb-aaf9-4b8c-8546-ba392a8d6614 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 3108d9e0-3b2d-402a-aaab-c313c30e7900] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:52.608032 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-7be20170-9869-424a-a253-5f310621c73f tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:52.627044 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-421b35eb-aaf9-4b8c-8546-ba392a8d6614 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:52.627863 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-421b35eb-aaf9-4b8c-8546-ba392a8d6614 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:52.629031 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-421b35eb-aaf9-4b8c-8546-ba392a8d6614 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:52.629832 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-421b35eb-aaf9-4b8c-8546-ba392a8d6614 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:52.706514 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-421b35eb-aaf9-4b8c-8546-ba392a8d6614 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:52.707538 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-421b35eb-aaf9-4b8c-8546-ba392a8d6614 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:52.710070 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.objects.instance [None req-421b35eb-aaf9-4b8c-8546-ba392a8d6614 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lazy-loading 'fault' on Instance uuid 3108d9e0-3b2d-402a-aaab-c313c30e7900 {{(pid=117885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 22 11:19:52.779678 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-421b35eb-aaf9-4b8c-8546-ba392a8d6614 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:19:52.788856 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-421b35eb-aaf9-4b8c-8546-ba392a8d6614 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900" status: 200 len: 1312 microversion: 2.1 time: 0.192646 Jul 22 11:19:52.790154 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 366/722] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:19:52 2022] GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900 => generated 1312 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:19:52.799044 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-e0ed61ba-f8ef-49f9-91d1-7863c61b7c1c tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:52.800216 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-e0ed61ba-f8ef-49f9-91d1-7863c61b7c1c tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: edc7a08a-180f-4907-9f8d-9d14bd9cf10c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:52.809172 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e0ed61ba-f8ef-49f9-91d1-7863c61b7c1c tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:52.811540 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e0ed61ba-f8ef-49f9-91d1-7863c61b7c1c tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:52.812959 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e0ed61ba-f8ef-49f9-91d1-7863c61b7c1c tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:52.813587 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e0ed61ba-f8ef-49f9-91d1-7863c61b7c1c tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:52.875249 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-7be20170-9869-424a-a253-5f310621c73f tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:19:52.885587 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-7be20170-9869-424a-a253-5f310621c73f tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/272976bd-b870-41a6-9bcd-598e1c9d34bc" status: 200 len: 1612 microversion: 2.1 time: 0.314265 Jul 22 11:19:52.886260 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 357/723] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:19:52 2022] GET /compute/v2.1/servers/272976bd-b870-41a6-9bcd-598e1c9d34bc => generated 1612 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:19:53.084906 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-e0ed61ba-f8ef-49f9-91d1-7863c61b7c1c tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:19:53.093949 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-e0ed61ba-f8ef-49f9-91d1-7863c61b7c1c tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/edc7a08a-180f-4907-9f8d-9d14bd9cf10c" status: 200 len: 1362 microversion: 2.1 time: 0.298897 Jul 22 11:19:53.094836 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 367/724] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:19:52 2022] GET /compute/v2.1/servers/edc7a08a-180f-4907-9f8d-9d14bd9cf10c => generated 1362 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:19:53.217187 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-df39ce80-c056-4afd-b106-3191531cedc7 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Action: 'create', calling method: .version_select at 0x7f844505a310>, body: {"keypair": {"name": "tempest-keypair-289085626", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMHGBizGvWx8RqFF/MBBlnWZpGynA/J2dmRL/aDHkH3SAn4whn909ChskOVF5bQCqXO5zagwtaTexC15dFUOSYkK2hjfUHE5WmVJlI1dGPprcqEC7E6Kb2VJ5ABb8B5h1w=="}} {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:19:53.234603 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.quota [None req-df39ce80-c056-4afd-b106-3191531cedc7 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Getting quotas for project b745569c01e04aa18f5494b0856bc3d1. Resources: {'key_pairs'} {{(pid=117884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 22 11:19:53.241523 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.quota [None req-df39ce80-c056-4afd-b106-3191531cedc7 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Getting quotas for user 99798aca08904bc787f5d0afee8d0ac7 and project b745569c01e04aa18f5494b0856bc3d1. Resources: {'key_pairs'} {{(pid=117884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 22 11:19:53.267029 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-df39ce80-c056-4afd-b106-3191531cedc7 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.054187 Jul 22 11:19:53.274719 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 358/725] 10.222.0.20 () {62 vars in 1199 bytes} [Fri Jul 22 11:19:53 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 63 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 22 11:19:53.810563 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-995b8081-8522-4172-bd38-e4a7203585bc tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:53.811184 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-995b8081-8522-4172-bd38-e4a7203585bc tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: 3108d9e0-3b2d-402a-aaab-c313c30e7900] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:53.823287 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-995b8081-8522-4172-bd38-e4a7203585bc tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:53.824043 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-995b8081-8522-4172-bd38-e4a7203585bc tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:53.825211 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-995b8081-8522-4172-bd38-e4a7203585bc tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:53.825826 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-995b8081-8522-4172-bd38-e4a7203585bc tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:53.848764 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.wsgi [None req-995b8081-8522-4172-bd38-e4a7203585bc tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] HTTP exception thrown: Instance 3108d9e0-3b2d-402a-aaab-c313c30e7900 could not be found. Jul 22 11:19:53.851480 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-995b8081-8522-4172-bd38-e4a7203585bc tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Request method failure captured: Jul 22 11:19:53.851480 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: request: GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900 HTTP/1.1 Jul 22 11:19:53.851480 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Accept: application/json Jul 22 11:19:53.851480 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Accept-Encoding: identity Jul 22 11:19:53.851480 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Connection: close Jul 22 11:19:53.851480 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Content-Length: 0 Jul 22 11:19:53.851480 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Content-Type: application/json Jul 22 11:19:53.851480 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Host: 10.222.0.20 Jul 22 11:19:53.851480 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Openstack-System-Scope: None Jul 22 11:19:53.851480 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: User-Agent: python-urllib3/1.26.9 Jul 22 11:19:53.851480 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Auth-Token: gAAAAABi2oZ_Qtszk4MNpu9uH6l3EUMK_AOOmV9E0vuS3FH7JkDwedj0MokFDNI6ti-i3aiOV4rP5TlBIaseQX6BcCMnHyQc2puFc3igItuqN6Fa-5lAd9CC5ZoEig99yVdCpczVS8L09dtiY0BgUBiyP4qmW8wj6-arLdMtONe-36WcUI5-aNY Jul 22 11:19:53.851480 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Domain-Id: None Jul 22 11:19:53.851480 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Domain-Name: None Jul 22 11:19:53.851480 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Identity-Status: Confirmed Jul 22 11:19:53.851480 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Is-Admin-Project: True Jul 22 11:19:53.851480 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Project-Domain-Id: default Jul 22 11:19:53.851480 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Project-Domain-Name: Default Jul 22 11:19:53.851480 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Project-Id: 601d12851417478a8b39bbf0c9fcd03d Jul 22 11:19:53.851480 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-821389900 Jul 22 11:19:53.851480 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Role: reader,member Jul 22 11:19:53.851480 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Roles: reader,member Jul 22 11:19:53.853028 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/601d12851417478a8b39bbf0c9fcd03d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_601d12851417478a8b39bbf0c9fcd03d", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/601d12851417478a8b39bbf0c9fcd03d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/601d12851417478a8b39bbf0c9fcd03d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jul 22 11:19:53.853028 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Tenant: tempest-ServerRescueNegativeTestJSON-821389900 Jul 22 11:19:53.853028 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Tenant-Id: 601d12851417478a8b39bbf0c9fcd03d Jul 22 11:19:53.853028 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-821389900 Jul 22 11:19:53.853028 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User: tempest-ServerRescueNegativeTestJSON-821389900-project Jul 22 11:19:53.853028 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User-Domain-Id: default Jul 22 11:19:53.853028 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User-Domain-Name: Default Jul 22 11:19:53.853028 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User-Id: 7c2c0270618240de8fd9290d01a7413a Jul 22 11:19:53.853028 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User-Name: tempest-ServerRescueNegativeTestJSON-821389900-project Jul 22 11:19:53.853028 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: method: > Jul 22 11:19:53.853028 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: exception: Instance 3108d9e0-3b2d-402a-aaab-c313c30e7900 could not be found. Jul 22 11:19:53.853028 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: action_args: {'id': '3108d9e0-3b2d-402a-aaab-c313c30e7900'} Jul 22 11:19:53.853887 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 22 11:19:53.853887 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:19:53.853887 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 22 11:19:53.853887 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 22 11:19:53.853887 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 22 11:19:53.853887 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 22 11:19:53.853887 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 22 11:19:53.853887 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 22 11:19:53.853887 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 22 11:19:53.853887 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 22 11:19:53.853887 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3108d9e0-3b2d-402a-aaab-c313c30e7900 could not be found. Jul 22 11:19:53.853887 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:19:53.853887 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:19:53.853887 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:19:53.853887 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:19:53.853887 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:19:53.853887 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:19:53.853887 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 22 11:19:53.853887 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 22 11:19:53.853887 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 22 11:19:53.855228 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 22 11:19:53.855228 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 22 11:19:53.855228 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 22 11:19:53.855228 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 22 11:19:53.855228 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 22 11:19:53.855228 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 22 11:19:53.855228 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 22 11:19:53.855228 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3108d9e0-3b2d-402a-aaab-c313c30e7900 could not be found. Jul 22 11:19:53.855228 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:19:53.855228 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:19:53.855228 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:19:53.855228 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:19:53.855228 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:19:53.855228 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:19:53.855228 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 22 11:19:53.855228 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 22 11:19:53.855228 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3108d9e0-3b2d-402a-aaab-c313c30e7900 could not be found. Jul 22 11:19:53.855228 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:19:53.857085 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-995b8081-8522-4172-bd38-e4a7203585bc tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Returning 404 to user: Instance 3108d9e0-3b2d-402a-aaab-c313c30e7900 could not be found. {{(pid=117885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 22 11:19:53.857085 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-995b8081-8522-4172-bd38-e4a7203585bc tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900" status: 404 len: 111 microversion: 2.1 time: 0.049051 Jul 22 11:19:53.857085 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 368/726] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:19:53 2022] GET /compute/v2.1/servers/3108d9e0-3b2d-402a-aaab-c313c30e7900 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 22 11:19:53.863428 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-b97dd4b8-8bbd-4ba7-9c51-88912f1223b3 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:53.864644 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-b97dd4b8-8bbd-4ba7-9c51-88912f1223b3 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: fbf8cb41-3496-45fe-9392-6add8f6873d0] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:53.872388 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-b97dd4b8-8bbd-4ba7-9c51-88912f1223b3 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:53.873285 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-b97dd4b8-8bbd-4ba7-9c51-88912f1223b3 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:53.874477 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-b97dd4b8-8bbd-4ba7-9c51-88912f1223b3 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:53.875079 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-b97dd4b8-8bbd-4ba7-9c51-88912f1223b3 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:53.906467 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-24fcd246-4163-4762-b836-c41b2bd2bacf tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:53.906892 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-24fcd246-4163-4762-b836-c41b2bd2bacf tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 272976bd-b870-41a6-9bcd-598e1c9d34bc] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:53.923054 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-24fcd246-4163-4762-b836-c41b2bd2bacf tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:53.923612 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-24fcd246-4163-4762-b836-c41b2bd2bacf tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:53.925444 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-24fcd246-4163-4762-b836-c41b2bd2bacf tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:53.925905 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-24fcd246-4163-4762-b836-c41b2bd2bacf tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:53.950399 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-b97dd4b8-8bbd-4ba7-9c51-88912f1223b3 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: fbf8cb41-3496-45fe-9392-6add8f6873d0] Going to try to terminate instance {{(pid=117884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 22 11:19:53.970091 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.wsgi [None req-24fcd246-4163-4762-b836-c41b2bd2bacf tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] HTTP exception thrown: Instance 272976bd-b870-41a6-9bcd-598e1c9d34bc could not be found. Jul 22 11:19:53.976090 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-24fcd246-4163-4762-b836-c41b2bd2bacf tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Request method failure captured: Jul 22 11:19:53.976090 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: request: GET /compute/v2.1/servers/272976bd-b870-41a6-9bcd-598e1c9d34bc HTTP/1.1 Jul 22 11:19:53.976090 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Accept: application/json Jul 22 11:19:53.976090 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Accept-Encoding: identity Jul 22 11:19:53.976090 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Connection: close Jul 22 11:19:53.976090 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Content-Length: 0 Jul 22 11:19:53.976090 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Content-Type: application/json Jul 22 11:19:53.976090 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Host: 10.222.0.20 Jul 22 11:19:53.976090 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Openstack-System-Scope: None Jul 22 11:19:53.976090 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: User-Agent: python-urllib3/1.26.9 Jul 22 11:19:53.976090 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Auth-Token: gAAAAABi2oZ52By6vC80uVvQ5nsWGLE19ZXI57S3ld1fjPibH8fuUYjCV8gJDPh42GzMe4RKMojTgGaj2CCjG1yohpK4Rm5k-mOJAFOmJU-P2lN4F8UiP8lUppBYVH0uVfdef6vJD72z_c72VmeWRwsVQhXxsOTWQe5Gh1G1aCThgwUg9CYgRRw Jul 22 11:19:53.976090 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Domain-Id: None Jul 22 11:19:53.976090 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Domain-Name: None Jul 22 11:19:53.976090 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Identity-Status: Confirmed Jul 22 11:19:53.976090 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Is-Admin-Project: True Jul 22 11:19:53.976090 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Project-Domain-Id: default Jul 22 11:19:53.976090 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Project-Domain-Name: Default Jul 22 11:19:53.976090 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Project-Id: 28836b7cb9c646aaaa1bb1c1fae68128 Jul 22 11:19:53.976090 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Project-Name: tempest-AttachVolumeNegativeTest-1017563372 Jul 22 11:19:53.976090 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Role: reader,member Jul 22 11:19:53.976090 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Roles: reader,member Jul 22 11:19:53.977606 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/28836b7cb9c646aaaa1bb1c1fae68128"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_28836b7cb9c646aaaa1bb1c1fae68128", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/28836b7cb9c646aaaa1bb1c1fae68128"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/28836b7cb9c646aaaa1bb1c1fae68128"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jul 22 11:19:53.977606 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Tenant: tempest-AttachVolumeNegativeTest-1017563372 Jul 22 11:19:53.977606 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Tenant-Id: 28836b7cb9c646aaaa1bb1c1fae68128 Jul 22 11:19:53.977606 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1017563372 Jul 22 11:19:53.977606 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User: tempest-AttachVolumeNegativeTest-1017563372-project Jul 22 11:19:53.977606 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User-Domain-Id: default Jul 22 11:19:53.977606 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User-Domain-Name: Default Jul 22 11:19:53.977606 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User-Id: 691877dce1024aeda61629073d74602b Jul 22 11:19:53.977606 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User-Name: tempest-AttachVolumeNegativeTest-1017563372-project Jul 22 11:19:53.977606 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: method: > Jul 22 11:19:53.977606 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: exception: Instance 272976bd-b870-41a6-9bcd-598e1c9d34bc could not be found. Jul 22 11:19:53.977606 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: action_args: {'id': '272976bd-b870-41a6-9bcd-598e1c9d34bc'} Jul 22 11:19:53.978448 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 22 11:19:53.978448 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:19:53.978448 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 22 11:19:53.978448 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 22 11:19:53.978448 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 22 11:19:53.978448 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 22 11:19:53.978448 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 22 11:19:53.978448 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 22 11:19:53.978448 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 22 11:19:53.978448 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 22 11:19:53.978448 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 272976bd-b870-41a6-9bcd-598e1c9d34bc could not be found. Jul 22 11:19:53.978448 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:19:53.978448 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:19:53.978448 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:19:53.978448 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:19:53.978448 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:19:53.978448 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:19:53.978448 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 22 11:19:53.978448 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 22 11:19:53.978448 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 22 11:19:53.979865 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 22 11:19:53.979865 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 22 11:19:53.979865 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 22 11:19:53.979865 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 22 11:19:53.979865 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 22 11:19:53.979865 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 22 11:19:53.979865 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 22 11:19:53.979865 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 272976bd-b870-41a6-9bcd-598e1c9d34bc could not be found. Jul 22 11:19:53.979865 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:19:53.979865 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:19:53.979865 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:19:53.979865 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:19:53.979865 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:19:53.979865 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:19:53.979865 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 22 11:19:53.979865 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 22 11:19:53.979865 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 272976bd-b870-41a6-9bcd-598e1c9d34bc could not be found. Jul 22 11:19:53.979865 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:19:53.981095 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-24fcd246-4163-4762-b836-c41b2bd2bacf tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Returning 404 to user: Instance 272976bd-b870-41a6-9bcd-598e1c9d34bc could not be found. {{(pid=117885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 22 11:19:53.981095 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-24fcd246-4163-4762-b836-c41b2bd2bacf tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/272976bd-b870-41a6-9bcd-598e1c9d34bc" status: 404 len: 111 microversion: 2.1 time: 0.078709 Jul 22 11:19:53.984367 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 369/727] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:19:53 2022] GET /compute/v2.1/servers/272976bd-b870-41a6-9bcd-598e1c9d34bc => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 22 11:19:53.988894 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG dbcounter [-] [117884] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:19:53.997529 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-dd204471-81de-496a-b2f1-827129869ce9 req-1d431f4e-60e4-41ed-97b2-6e3d82601415 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edc7a08a-180f-4907-9f8d-9d14bd9cf10c", "tag": "bf7a4ec0-a612-481f-81ec-02d77677b359"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:19:54.018420 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-dd204471-81de-496a-b2f1-827129869ce9 req-1d431f4e-60e4-41ed-97b2-6e3d82601415 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:54.018420 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-dd204471-81de-496a-b2f1-827129869ce9 req-1d431f4e-60e4-41ed-97b2-6e3d82601415 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:54.032464 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-dd204471-81de-496a-b2f1-827129869ce9 req-1d431f4e-60e4-41ed-97b2-6e3d82601415 service nova] Creating event network-changed:bf7a4ec0-a612-481f-81ec-02d77677b359 for instance edc7a08a-180f-4907-9f8d-9d14bd9cf10c on hv-cinder-84890 Jul 22 11:19:54.040530 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-dd204471-81de-496a-b2f1-827129869ce9 req-1d431f4e-60e4-41ed-97b2-6e3d82601415 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054014 Jul 22 11:19:54.042726 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 370/728] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:19:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:19:54.049360 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-f76e01e9-fbef-4981-a2cb-5edbfd3baa36 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '.version_select at 0x7f844994cf70>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:54.090627 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-b97dd4b8-8bbd-4ba7-9c51-88912f1223b3 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "DELETE /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0" status: 204 len: 0 microversion: 2.1 time: 0.228298 Jul 22 11:19:54.091209 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 359/729] 10.222.0.20 () {58 vars in 1238 bytes} [Fri Jul 22 11:19:53 2022] DELETE /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 22 11:19:54.102511 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-f76e01e9-fbef-4981-a2cb-5edbfd3baa36 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1673128683" status: 202 len: 0 microversion: 2.1 time: 0.057924 Jul 22 11:19:54.103490 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 371/730] 10.222.0.20 () {58 vars in 1220 bytes} [Fri Jul 22 11:19:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1673128683 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 22 11:19:54.108148 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [req-566c7b95-a870-4618-9e50-eb0fd2abb1c6 req-5237dd33-8ddd-4469-823a-bf2a3aa2fd62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "272976bd-b870-41a6-9bcd-598e1c9d34bc", "name": "network-vif-deleted", "tag": "c4d22b99-709d-4d50-a237-82850eeff0a1"}]} {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:19:54.112428 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-fcebba84-bb52-4e5d-87f7-b548ec5cc8cd tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:54.113197 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-fcebba84-bb52-4e5d-87f7-b548ec5cc8cd tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: fbf8cb41-3496-45fe-9392-6add8f6873d0] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:54.122592 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fcebba84-bb52-4e5d-87f7-b548ec5cc8cd tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:54.123552 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fcebba84-bb52-4e5d-87f7-b548ec5cc8cd tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:54.123870 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-566c7b95-a870-4618-9e50-eb0fd2abb1c6 req-5237dd33-8ddd-4469-823a-bf2a3aa2fd62 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:54.124559 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-566c7b95-a870-4618-9e50-eb0fd2abb1c6 req-5237dd33-8ddd-4469-823a-bf2a3aa2fd62 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:54.125891 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fcebba84-bb52-4e5d-87f7-b548ec5cc8cd tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:54.126860 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fcebba84-bb52-4e5d-87f7-b548ec5cc8cd tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:54.149270 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.compute.server_external_events [req-566c7b95-a870-4618-9e50-eb0fd2abb1c6 req-5237dd33-8ddd-4469-823a-bf2a3aa2fd62 service nova] Creating event network-vif-deleted:c4d22b99-709d-4d50-a237-82850eeff0a1 for instance 272976bd-b870-41a6-9bcd-598e1c9d34bc on hv-cinder-84890 Jul 22 11:19:54.156741 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [req-566c7b95-a870-4618-9e50-eb0fd2abb1c6 req-5237dd33-8ddd-4469-823a-bf2a3aa2fd62 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061772 Jul 22 11:19:54.157480 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 360/731] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:19:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:19:54.166603 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-f7e420aa-1cd0-4a5b-93d3-e0f4e8d81efb tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:54.171188 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-f7e420aa-1cd0-4a5b-93d3-e0f4e8d81efb tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: edc7a08a-180f-4907-9f8d-9d14bd9cf10c] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:54.186446 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f7e420aa-1cd0-4a5b-93d3-e0f4e8d81efb tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:54.186920 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f7e420aa-1cd0-4a5b-93d3-e0f4e8d81efb tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:54.187746 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f7e420aa-1cd0-4a5b-93d3-e0f4e8d81efb tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:54.188183 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f7e420aa-1cd0-4a5b-93d3-e0f4e8d81efb tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:54.354174 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-fcebba84-bb52-4e5d-87f7-b548ec5cc8cd tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:19:54.365108 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-fcebba84-bb52-4e5d-87f7-b548ec5cc8cd tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0" status: 200 len: 1522 microversion: 2.1 time: 0.258180 Jul 22 11:19:54.375512 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 372/732] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:19:54 2022] GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0 => generated 1522 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:19:54.544639 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-f7e420aa-1cd0-4a5b-93d3-e0f4e8d81efb tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:19:54.553405 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-f7e420aa-1cd0-4a5b-93d3-e0f4e8d81efb tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/edc7a08a-180f-4907-9f8d-9d14bd9cf10c" status: 200 len: 1362 microversion: 2.1 time: 0.394495 Jul 22 11:19:54.554423 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 361/733] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:19:54 2022] GET /compute/v2.1/servers/edc7a08a-180f-4907-9f8d-9d14bd9cf10c => generated 1362 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:19:55.153736 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-42a731fa-b72c-4d88-803a-d0a1028003f4 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Action: 'create', calling method: .version_select at 0x7f84451ad8b0>, body: {"keypair": {"name": "tempest-keypair-1420537121", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIw2PRbGoc/UZe6qRSQrcT9nWGFBhoKfSX7YGcRcZCRmfcPGmISya4niPZGH4k/SWJ73cK9Bg0NwHXkXOtyBbWDHC3sSNsFM+mRp9t/h+y5ukHgob7HQi6v8ld+SIkyAEA=="}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:19:55.169353 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-42a731fa-b72c-4d88-803a-d0a1028003f4 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Getting quotas for project 28836b7cb9c646aaaa1bb1c1fae68128. Resources: {'key_pairs'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 22 11:19:55.173372 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-42a731fa-b72c-4d88-803a-d0a1028003f4 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Getting quotas for user 691877dce1024aeda61629073d74602b and project 28836b7cb9c646aaaa1bb1c1fae68128. Resources: {'key_pairs'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 22 11:19:55.191964 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-8695d865-4d25-4901-acc8-4f96135cd0e0 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1148023272", "imageRef": "1a6c3cb4-9f56-44c6-aa68-01000df27209", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7318ffdd-ae63-4738-8d01-53fbef338615"}], "security_groups": [{"name": "tempest-securitygroup--1248883238"}], "key_name": "tempest-keypair-289085626", "user_data": "}} {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:19:55.198879 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-42a731fa-b72c-4d88-803a-d0a1028003f4 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048989 Jul 22 11:19:55.199532 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 373/734] 10.222.0.20 () {60 vars in 1158 bytes} [Fri Jul 22 11:19:55 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 22 11:19:55.314894 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.network.neutron [None req-8695d865-4d25-4901-acc8-4f96135cd0e0 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] validate_networks() for [('7318ffdd-ae63-4738-8d01-53fbef338615', None, None, None, None, None)] {{(pid=117884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 22 11:19:55.386301 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-f5103352-4769-42e4-b109-33c211f2c7df tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:55.387485 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-f5103352-4769-42e4-b109-33c211f2c7df tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: fbf8cb41-3496-45fe-9392-6add8f6873d0] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:55.395147 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f5103352-4769-42e4-b109-33c211f2c7df tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:55.395644 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f5103352-4769-42e4-b109-33c211f2c7df tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:55.396581 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f5103352-4769-42e4-b109-33c211f2c7df tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:55.397112 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f5103352-4769-42e4-b109-33c211f2c7df tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:55.608820 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-f5103352-4769-42e4-b109-33c211f2c7df tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:19:55.619036 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-f5103352-4769-42e4-b109-33c211f2c7df tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0" status: 200 len: 1522 microversion: 2.1 time: 0.236962 Jul 22 11:19:55.619677 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 374/735] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:19:55 2022] GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0 => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:19:55.635768 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-54419388-8e52-48e2-87f5-783d69d75fd6 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:55.636769 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-54419388-8e52-48e2-87f5-783d69d75fd6 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: edc7a08a-180f-4907-9f8d-9d14bd9cf10c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:55.644438 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-54419388-8e52-48e2-87f5-783d69d75fd6 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:55.644438 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-54419388-8e52-48e2-87f5-783d69d75fd6 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:55.644775 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-54419388-8e52-48e2-87f5-783d69d75fd6 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:55.645400 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-54419388-8e52-48e2-87f5-783d69d75fd6 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:55.859030 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-54419388-8e52-48e2-87f5-783d69d75fd6 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:19:55.868530 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-54419388-8e52-48e2-87f5-783d69d75fd6 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/edc7a08a-180f-4907-9f8d-9d14bd9cf10c" status: 200 len: 1362 microversion: 2.1 time: 0.237541 Jul 22 11:19:55.878497 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 375/736] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:19:55 2022] GET /compute/v2.1/servers/edc7a08a-180f-4907-9f8d-9d14bd9cf10c => generated 1362 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:19:55.896764 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.virt.hardware [None req-8695d865-4d25-4901-acc8-4f96135cd0e0 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Flavor limits 0:0:0 {{(pid=117884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 22 11:19:55.897183 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.virt.hardware [None req-8695d865-4d25-4901-acc8-4f96135cd0e0 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Image limits 0:0:0 {{(pid=117884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 22 11:19:55.897679 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.virt.hardware [None req-8695d865-4d25-4901-acc8-4f96135cd0e0 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Flavor pref 0:0:0 {{(pid=117884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 22 11:19:55.898079 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.virt.hardware [None req-8695d865-4d25-4901-acc8-4f96135cd0e0 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Image pref 0:0:0 {{(pid=117884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 22 11:19:55.898524 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.virt.hardware [None req-8695d865-4d25-4901-acc8-4f96135cd0e0 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 22 11:19:55.907582 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-8695d865-4d25-4901-acc8-4f96135cd0e0 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:55.908029 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-8695d865-4d25-4901-acc8-4f96135cd0e0 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:55.909196 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-8695d865-4d25-4901-acc8-4f96135cd0e0 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:55.909632 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-8695d865-4d25-4901-acc8-4f96135cd0e0 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:55.926896 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.quota [None req-8695d865-4d25-4901-acc8-4f96135cd0e0 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Getting quotas for project b745569c01e04aa18f5494b0856bc3d1. Resources: {'instances', 'cores', 'ram'} {{(pid=117884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 22 11:19:55.931072 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.quota [None req-8695d865-4d25-4901-acc8-4f96135cd0e0 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Getting quotas for user 99798aca08904bc787f5d0afee8d0ac7 and project b745569c01e04aa18f5494b0856bc3d1. Resources: {'instances', 'cores', 'ram'} {{(pid=117884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 22 11:19:55.943530 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-8695d865-4d25-4901-acc8-4f96135cd0e0 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Going to run 1 instances... {{(pid=117884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 22 11:19:55.946195 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-8695d865-4d25-4901-acc8-4f96135cd0e0 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1a6c3cb4-9f56-44c6-aa68-01000df27209',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 22 11:19:56.001634 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-8695d865-4d25-4901-acc8-4f96135cd0e0 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.813877 Jul 22 11:19:56.002577 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 362/737] 10.222.0.20 () {62 vars in 1187 bytes} [Fri Jul 22 11:19:55 2022] POST /compute/v2.1/servers => generated 402 bytes in 815 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 22 11:19:56.016850 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-13648eb8-8ff3-4859-970f-966634100ea9 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:56.017580 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-13648eb8-8ff3-4859-970f-966634100ea9 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:56.096801 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-13648eb8-8ff3-4859-970f-966634100ea9 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:19:56.106098 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-13648eb8-8ff3-4859-970f-966634100ea9 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:19:56.107517 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-13648eb8-8ff3-4859-970f-966634100ea9 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:19:56.108687 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-13648eb8-8ff3-4859-970f-966634100ea9 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46" status: 200 len: 1281 microversion: 2.20 time: 0.098864 Jul 22 11:19:56.109411 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 376/738] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:19:56 2022] GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 => generated 1281 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:19:56.639623 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-a8214529-6636-4b03-b470-ae2d86db8b6e tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:56.641175 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-a8214529-6636-4b03-b470-ae2d86db8b6e tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: fbf8cb41-3496-45fe-9392-6add8f6873d0] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:56.651151 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-a8214529-6636-4b03-b470-ae2d86db8b6e tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:56.651622 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-a8214529-6636-4b03-b470-ae2d86db8b6e tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:56.652533 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-a8214529-6636-4b03-b470-ae2d86db8b6e tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:56.653013 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-a8214529-6636-4b03-b470-ae2d86db8b6e tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:56.879855 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-a8214529-6636-4b03-b470-ae2d86db8b6e tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:19:56.887036 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-dfaf0840-5ec0-4db4-881b-5ca10b9a485a tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:56.888818 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-dfaf0840-5ec0-4db4-881b-5ca10b9a485a tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: edc7a08a-180f-4907-9f8d-9d14bd9cf10c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:56.890048 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-a8214529-6636-4b03-b470-ae2d86db8b6e tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0" status: 200 len: 1522 microversion: 2.1 time: 0.254676 Jul 22 11:19:56.891169 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 363/739] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:19:56 2022] GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0 => generated 1522 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:19:56.892517 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell0:SELECT=2 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:19:56.906352 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dfaf0840-5ec0-4db4-881b-5ca10b9a485a tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:56.907097 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dfaf0840-5ec0-4db4-881b-5ca10b9a485a tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:56.907932 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dfaf0840-5ec0-4db4-881b-5ca10b9a485a tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:56.908376 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dfaf0840-5ec0-4db4-881b-5ca10b9a485a tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:57.127558 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-cec37e30-cce6-4efe-997e-6dde8df4d915 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:57.128428 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-cec37e30-cce6-4efe-997e-6dde8df4d915 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:57.136394 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-cec37e30-cce6-4efe-997e-6dde8df4d915 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:57.136839 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-cec37e30-cce6-4efe-997e-6dde8df4d915 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:57.137907 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-cec37e30-cce6-4efe-997e-6dde8df4d915 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:57.138344 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-cec37e30-cce6-4efe-997e-6dde8df4d915 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:57.159773 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-dfaf0840-5ec0-4db4-881b-5ca10b9a485a tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:19:57.167983 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-dfaf0840-5ec0-4db4-881b-5ca10b9a485a tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/edc7a08a-180f-4907-9f8d-9d14bd9cf10c" status: 200 len: 1362 microversion: 2.1 time: 0.285250 Jul 22 11:19:57.172738 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 377/740] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:19:56 2022] GET /compute/v2.1/servers/edc7a08a-180f-4907-9f8d-9d14bd9cf10c => generated 1362 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:19:57.184558 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-21dec384-e9e6-4464-b040-c1a8107390b0 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-460264800", "imageRef": "1a6c3cb4-9f56-44c6-aa68-01000df27209", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "32cd3386-64da-4740-85d1-ffc0b29096eb"}], "security_groups": [{"name": "tempest-securitygroup--788449122"}], "key_name": "tempest-keypair-1420537121", "user_data": "}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:19:57.241329 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-cec37e30-cce6-4efe-997e-6dde8df4d915 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:19:57.251992 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-cec37e30-cce6-4efe-997e-6dde8df4d915 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:19:57.253665 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-cec37e30-cce6-4efe-997e-6dde8df4d915 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:19:57.254956 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-cec37e30-cce6-4efe-997e-6dde8df4d915 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46" status: 200 len: 1333 microversion: 2.20 time: 0.131571 Jul 22 11:19:57.255603 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 364/741] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:19:57 2022] GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 => generated 1333 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 22 11:19:57.306562 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.network.neutron [None req-21dec384-e9e6-4464-b040-c1a8107390b0 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] validate_networks() for [('32cd3386-64da-4740-85d1-ffc0b29096eb', None, None, None, None, None)] {{(pid=117885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 22 11:19:57.364582 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [req-a8bfb908-de5f-4d79-a0fb-6c29d8d74487 req-c96bb3e0-855d-49c9-892b-7967cd6e11f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbf8cb41-3496-45fe-9392-6add8f6873d0", "name": "network-vif-deleted", "tag": "6c864331-87d8-4526-8824-f0d87403783e"}]} {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:19:57.375443 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-a8bfb908-de5f-4d79-a0fb-6c29d8d74487 req-c96bb3e0-855d-49c9-892b-7967cd6e11f4 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:57.375443 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-a8bfb908-de5f-4d79-a0fb-6c29d8d74487 req-c96bb3e0-855d-49c9-892b-7967cd6e11f4 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:57.387195 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.compute.server_external_events [req-a8bfb908-de5f-4d79-a0fb-6c29d8d74487 req-c96bb3e0-855d-49c9-892b-7967cd6e11f4 service nova] Creating event network-vif-deleted:6c864331-87d8-4526-8824-f0d87403783e for instance fbf8cb41-3496-45fe-9392-6add8f6873d0 on hv-cinder-84890 Jul 22 11:19:57.392547 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [req-a8bfb908-de5f-4d79-a0fb-6c29d8d74487 req-c96bb3e0-855d-49c9-892b-7967cd6e11f4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032002 Jul 22 11:19:57.393200 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 365/742] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:19:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 22 11:19:57.729257 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-21dec384-e9e6-4464-b040-c1a8107390b0 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Flavor limits 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 22 11:19:57.729701 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-21dec384-e9e6-4464-b040-c1a8107390b0 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Image limits 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 22 11:19:57.730172 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-21dec384-e9e6-4464-b040-c1a8107390b0 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Flavor pref 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 22 11:19:57.730577 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-21dec384-e9e6-4464-b040-c1a8107390b0 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Image pref 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 22 11:19:57.731101 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-21dec384-e9e6-4464-b040-c1a8107390b0 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 22 11:19:57.741462 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-21dec384-e9e6-4464-b040-c1a8107390b0 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:57.741910 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-21dec384-e9e6-4464-b040-c1a8107390b0 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:57.742712 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-21dec384-e9e6-4464-b040-c1a8107390b0 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:57.743147 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-21dec384-e9e6-4464-b040-c1a8107390b0 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:57.752566 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=100 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:19:57.767843 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-21dec384-e9e6-4464-b040-c1a8107390b0 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Getting quotas for project 28836b7cb9c646aaaa1bb1c1fae68128. Resources: {'instances', 'cores', 'ram'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 22 11:19:57.774318 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-21dec384-e9e6-4464-b040-c1a8107390b0 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Getting quotas for user 691877dce1024aeda61629073d74602b and project 28836b7cb9c646aaaa1bb1c1fae68128. Resources: {'instances', 'cores', 'ram'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 22 11:19:57.787610 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-21dec384-e9e6-4464-b040-c1a8107390b0 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Going to run 1 instances... {{(pid=117885) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 22 11:19:57.789485 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-21dec384-e9e6-4464-b040-c1a8107390b0 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 27286438-bce0-447c-9406-2d776cc7c81d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1a6c3cb4-9f56-44c6-aa68-01000df27209',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 22 11:19:57.857554 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-21dec384-e9e6-4464-b040-c1a8107390b0 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.682843 Jul 22 11:19:57.858388 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 378/743] 10.222.0.20 () {60 vars in 1146 bytes} [Fri Jul 22 11:19:57 2022] POST /compute/v2.1/servers => generated 401 bytes in 685 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 22 11:19:57.869268 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-60ca483a-0c84-40d3-9743-5529ecfe582f tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:57.870611 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-60ca483a-0c84-40d3-9743-5529ecfe582f tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 27286438-bce0-447c-9406-2d776cc7c81d] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:57.907755 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-d985f439-76a2-4b82-b3f1-69c4e836e0ad tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:57.909528 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-d985f439-76a2-4b82-b3f1-69c4e836e0ad tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: fbf8cb41-3496-45fe-9392-6add8f6873d0] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:57.912807 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:DELETE=2 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:19:57.917483 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d985f439-76a2-4b82-b3f1-69c4e836e0ad tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:57.918150 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d985f439-76a2-4b82-b3f1-69c4e836e0ad tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:57.919083 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d985f439-76a2-4b82-b3f1-69c4e836e0ad tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:57.919698 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d985f439-76a2-4b82-b3f1-69c4e836e0ad tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:57.995886 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-d985f439-76a2-4b82-b3f1-69c4e836e0ad tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2c0270618240de8fd9290d01a7413a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601d12851417478a8b39bbf0c9fcd03d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:19:58.017574 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-d985f439-76a2-4b82-b3f1-69c4e836e0ad tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0" status: 200 len: 1307 microversion: 2.1 time: 0.114446 Jul 22 11:19:58.022300 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-60ca483a-0c84-40d3-9743-5529ecfe582f tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:19:58.023623 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 379/744] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:19:57 2022] GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0 => generated 1307 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:19:58.032835 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-60ca483a-0c84-40d3-9743-5529ecfe582f tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/27286438-bce0-447c-9406-2d776cc7c81d" status: 200 len: 1241 microversion: 2.1 time: 0.167742 Jul 22 11:19:58.033740 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 366/745] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:19:57 2022] GET /compute/v2.1/servers/27286438-bce0-447c-9406-2d776cc7c81d => generated 1241 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:19:58.191908 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-13d01a1e-c0a2-47e5-a9e0-2ff13a8ae14c tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:58.192517 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-13d01a1e-c0a2-47e5-a9e0-2ff13a8ae14c tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: edc7a08a-180f-4907-9f8d-9d14bd9cf10c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:58.199484 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-13d01a1e-c0a2-47e5-a9e0-2ff13a8ae14c tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:58.199934 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-13d01a1e-c0a2-47e5-a9e0-2ff13a8ae14c tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:58.200725 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-13d01a1e-c0a2-47e5-a9e0-2ff13a8ae14c tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:58.201174 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-13d01a1e-c0a2-47e5-a9e0-2ff13a8ae14c tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:58.273631 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-562bb5cb-0214-4ef5-b427-1f719e4ae4d4 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:58.274481 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-562bb5cb-0214-4ef5-b427-1f719e4ae4d4 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:58.281751 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-562bb5cb-0214-4ef5-b427-1f719e4ae4d4 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:58.282310 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-562bb5cb-0214-4ef5-b427-1f719e4ae4d4 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:58.283159 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-562bb5cb-0214-4ef5-b427-1f719e4ae4d4 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:58.283783 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-562bb5cb-0214-4ef5-b427-1f719e4ae4d4 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:58.416823 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-562bb5cb-0214-4ef5-b427-1f719e4ae4d4 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:19:58.428349 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-562bb5cb-0214-4ef5-b427-1f719e4ae4d4 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:19:58.429452 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-562bb5cb-0214-4ef5-b427-1f719e4ae4d4 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:19:58.430586 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-562bb5cb-0214-4ef5-b427-1f719e4ae4d4 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46" status: 200 len: 1339 microversion: 2.20 time: 0.161321 Jul 22 11:19:58.431196 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 367/746] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:19:58 2022] GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 => generated 1339 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:19:58.433873 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-13d01a1e-c0a2-47e5-a9e0-2ff13a8ae14c tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:19:58.442057 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-13d01a1e-c0a2-47e5-a9e0-2ff13a8ae14c tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/edc7a08a-180f-4907-9f8d-9d14bd9cf10c" status: 200 len: 1362 microversion: 2.1 time: 0.253947 Jul 22 11:19:58.442966 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 380/747] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:19:58 2022] GET /compute/v2.1/servers/edc7a08a-180f-4907-9f8d-9d14bd9cf10c => generated 1362 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:19:59.039208 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-f8b9ea1d-df32-4395-a835-c57ad5ab6ed0 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:59.040463 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-f8b9ea1d-df32-4395-a835-c57ad5ab6ed0 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] [instance: fbf8cb41-3496-45fe-9392-6add8f6873d0] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:59.047837 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f8b9ea1d-df32-4395-a835-c57ad5ab6ed0 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:59.048569 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f8b9ea1d-df32-4395-a835-c57ad5ab6ed0 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:59.049516 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f8b9ea1d-df32-4395-a835-c57ad5ab6ed0 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:59.050142 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f8b9ea1d-df32-4395-a835-c57ad5ab6ed0 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:59.050660 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-678ea7d7-d39e-44e7-befc-0f0cf405c9cd tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:59.052001 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-678ea7d7-d39e-44e7-befc-0f0cf405c9cd tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 27286438-bce0-447c-9406-2d776cc7c81d] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:59.059318 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-678ea7d7-d39e-44e7-befc-0f0cf405c9cd tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:59.060158 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-678ea7d7-d39e-44e7-befc-0f0cf405c9cd tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:59.061283 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-678ea7d7-d39e-44e7-befc-0f0cf405c9cd tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:59.061908 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-678ea7d7-d39e-44e7-befc-0f0cf405c9cd tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:59.074742 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.wsgi [None req-f8b9ea1d-df32-4395-a835-c57ad5ab6ed0 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] HTTP exception thrown: Instance fbf8cb41-3496-45fe-9392-6add8f6873d0 could not be found. Jul 22 11:19:59.078747 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-f8b9ea1d-df32-4395-a835-c57ad5ab6ed0 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Request method failure captured: Jul 22 11:19:59.078747 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: request: GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0 HTTP/1.1 Jul 22 11:19:59.078747 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Accept: application/json Jul 22 11:19:59.078747 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Accept-Encoding: identity Jul 22 11:19:59.078747 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Connection: close Jul 22 11:19:59.078747 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Content-Length: 0 Jul 22 11:19:59.078747 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Content-Type: application/json Jul 22 11:19:59.078747 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Host: 10.222.0.20 Jul 22 11:19:59.078747 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Openstack-System-Scope: None Jul 22 11:19:59.078747 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: User-Agent: python-urllib3/1.26.9 Jul 22 11:19:59.078747 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Auth-Token: gAAAAABi2oZ_Qtszk4MNpu9uH6l3EUMK_AOOmV9E0vuS3FH7JkDwedj0MokFDNI6ti-i3aiOV4rP5TlBIaseQX6BcCMnHyQc2puFc3igItuqN6Fa-5lAd9CC5ZoEig99yVdCpczVS8L09dtiY0BgUBiyP4qmW8wj6-arLdMtONe-36WcUI5-aNY Jul 22 11:19:59.078747 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Domain-Id: None Jul 22 11:19:59.078747 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Domain-Name: None Jul 22 11:19:59.078747 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Identity-Status: Confirmed Jul 22 11:19:59.078747 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Is-Admin-Project: True Jul 22 11:19:59.078747 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Domain-Id: default Jul 22 11:19:59.078747 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Domain-Name: Default Jul 22 11:19:59.078747 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Id: 601d12851417478a8b39bbf0c9fcd03d Jul 22 11:19:59.078747 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-821389900 Jul 22 11:19:59.078747 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Role: reader,member Jul 22 11:19:59.078747 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Roles: reader,member Jul 22 11:19:59.080714 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/601d12851417478a8b39bbf0c9fcd03d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_601d12851417478a8b39bbf0c9fcd03d", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/601d12851417478a8b39bbf0c9fcd03d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/601d12851417478a8b39bbf0c9fcd03d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jul 22 11:19:59.080714 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant: tempest-ServerRescueNegativeTestJSON-821389900 Jul 22 11:19:59.080714 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant-Id: 601d12851417478a8b39bbf0c9fcd03d Jul 22 11:19:59.080714 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-821389900 Jul 22 11:19:59.080714 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User: tempest-ServerRescueNegativeTestJSON-821389900-project Jul 22 11:19:59.080714 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Domain-Id: default Jul 22 11:19:59.080714 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Domain-Name: Default Jul 22 11:19:59.080714 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Id: 7c2c0270618240de8fd9290d01a7413a Jul 22 11:19:59.080714 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Name: tempest-ServerRescueNegativeTestJSON-821389900-project Jul 22 11:19:59.080714 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: method: > Jul 22 11:19:59.080714 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: exception: Instance fbf8cb41-3496-45fe-9392-6add8f6873d0 could not be found. Jul 22 11:19:59.080714 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: action_args: {'id': 'fbf8cb41-3496-45fe-9392-6add8f6873d0'} Jul 22 11:19:59.081834 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 22 11:19:59.081834 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:19:59.081834 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 22 11:19:59.081834 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 22 11:19:59.081834 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 22 11:19:59.081834 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 22 11:19:59.081834 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 22 11:19:59.081834 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 22 11:19:59.081834 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 22 11:19:59.081834 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 22 11:19:59.081834 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbf8cb41-3496-45fe-9392-6add8f6873d0 could not be found. Jul 22 11:19:59.081834 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:19:59.081834 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:19:59.081834 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:19:59.081834 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:19:59.081834 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:19:59.081834 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:19:59.081834 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 22 11:19:59.081834 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 22 11:19:59.081834 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 22 11:19:59.083832 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 22 11:19:59.083832 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 22 11:19:59.083832 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 22 11:19:59.083832 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 22 11:19:59.083832 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 22 11:19:59.083832 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 22 11:19:59.083832 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 22 11:19:59.083832 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbf8cb41-3496-45fe-9392-6add8f6873d0 could not be found. Jul 22 11:19:59.083832 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:19:59.083832 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:19:59.083832 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:19:59.083832 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:19:59.083832 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:19:59.083832 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:19:59.083832 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 22 11:19:59.083832 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 22 11:19:59.083832 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbf8cb41-3496-45fe-9392-6add8f6873d0 could not be found. Jul 22 11:19:59.083832 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:19:59.086786 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-f8b9ea1d-df32-4395-a835-c57ad5ab6ed0 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] Returning 404 to user: Instance fbf8cb41-3496-45fe-9392-6add8f6873d0 could not be found. {{(pid=117884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 22 11:19:59.087914 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-f8b9ea1d-df32-4395-a835-c57ad5ab6ed0 tempest-ServerRescueNegativeTestJSON-821389900 tempest-ServerRescueNegativeTestJSON-821389900-project] 10.222.0.20 "GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0" status: 404 len: 111 microversion: 2.1 time: 0.053270 Jul 22 11:19:59.089165 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 368/748] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:19:59 2022] GET /compute/v2.1/servers/fbf8cb41-3496-45fe-9392-6add8f6873d0 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 22 11:19:59.172257 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-678ea7d7-d39e-44e7-befc-0f0cf405c9cd tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:19:59.188081 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-678ea7d7-d39e-44e7-befc-0f0cf405c9cd tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/27286438-bce0-447c-9406-2d776cc7c81d" status: 200 len: 1293 microversion: 2.1 time: 0.141955 Jul 22 11:19:59.188825 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 381/749] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:19:59 2022] GET /compute/v2.1/servers/27286438-bce0-447c-9406-2d776cc7c81d => generated 1293 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:19:59.448889 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-2c7da373-b98f-48f3-aac0-035b3ed03daf tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:59.449498 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-2c7da373-b98f-48f3-aac0-035b3ed03daf tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:59.459780 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-2c7da373-b98f-48f3-aac0-035b3ed03daf tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:59.460088 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-ae859848-6c8e-44c9-9717-12607e7ab193 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:19:59.460381 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-2c7da373-b98f-48f3-aac0-035b3ed03daf tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:59.460554 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-ae859848-6c8e-44c9-9717-12607e7ab193 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: edc7a08a-180f-4907-9f8d-9d14bd9cf10c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:19:59.461191 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-2c7da373-b98f-48f3-aac0-035b3ed03daf tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:59.461658 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-2c7da373-b98f-48f3-aac0-035b3ed03daf tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:59.473287 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ae859848-6c8e-44c9-9717-12607e7ab193 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:59.476667 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ae859848-6c8e-44c9-9717-12607e7ab193 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:59.479176 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ae859848-6c8e-44c9-9717-12607e7ab193 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:59.479924 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ae859848-6c8e-44c9-9717-12607e7ab193 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:59.750101 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-ae859848-6c8e-44c9-9717-12607e7ab193 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:19:59.763044 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-ae859848-6c8e-44c9-9717-12607e7ab193 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/edc7a08a-180f-4907-9f8d-9d14bd9cf10c" status: 200 len: 1362 microversion: 2.1 time: 0.307671 Jul 22 11:19:59.767675 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 382/750] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:19:59 2022] GET /compute/v2.1/servers/edc7a08a-180f-4907-9f8d-9d14bd9cf10c => generated 1362 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:19:59.784352 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-2c7da373-b98f-48f3-aac0-035b3ed03daf tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:19:59.797868 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-2c7da373-b98f-48f3-aac0-035b3ed03daf tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:19:59.799433 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-2c7da373-b98f-48f3-aac0-035b3ed03daf tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:19:59.801093 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-2c7da373-b98f-48f3-aac0-035b3ed03daf tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46" status: 200 len: 1407 microversion: 2.20 time: 0.356200 Jul 22 11:19:59.811734 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 369/751] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:19:59 2022] GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 => generated 1407 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:19:59.922499 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-cb6bd28c-207a-4e4c-a0e0-8199137423db req-7454ce8d-e7ee-4088-a735-07fe4bad3d42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46", "tag": "c1ac6e13-743e-4cd7-b970-2f05998ba958"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:19:59.938921 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-cb6bd28c-207a-4e4c-a0e0-8199137423db req-7454ce8d-e7ee-4088-a735-07fe4bad3d42 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:19:59.939390 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-cb6bd28c-207a-4e4c-a0e0-8199137423db req-7454ce8d-e7ee-4088-a735-07fe4bad3d42 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:19:59.954983 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-cb6bd28c-207a-4e4c-a0e0-8199137423db req-7454ce8d-e7ee-4088-a735-07fe4bad3d42 service nova] Creating event network-changed:c1ac6e13-743e-4cd7-b970-2f05998ba958 for instance f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 on hv-cinder-84890 Jul 22 11:19:59.975456 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-cb6bd28c-207a-4e4c-a0e0-8199137423db req-7454ce8d-e7ee-4088-a735-07fe4bad3d42 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055567 Jul 22 11:19:59.977064 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 383/752] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:19:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 22 11:20:00.212764 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-a66bb5f4-d14c-41f6-bc71-4f1f5bf9bde5 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:20:00.214507 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-a66bb5f4-d14c-41f6-bc71-4f1f5bf9bde5 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 27286438-bce0-447c-9406-2d776cc7c81d] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:20:00.222131 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-a66bb5f4-d14c-41f6-bc71-4f1f5bf9bde5 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:20:00.222825 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-a66bb5f4-d14c-41f6-bc71-4f1f5bf9bde5 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:20:00.223810 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-a66bb5f4-d14c-41f6-bc71-4f1f5bf9bde5 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:20:00.224448 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-a66bb5f4-d14c-41f6-bc71-4f1f5bf9bde5 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:20:00.350090 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-a66bb5f4-d14c-41f6-bc71-4f1f5bf9bde5 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:20:00.360188 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-a66bb5f4-d14c-41f6-bc71-4f1f5bf9bde5 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/27286438-bce0-447c-9406-2d776cc7c81d" status: 200 len: 1299 microversion: 2.1 time: 0.155378 Jul 22 11:20:00.360785 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 370/753] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:20:00 2022] GET /compute/v2.1/servers/27286438-bce0-447c-9406-2d776cc7c81d => generated 1299 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:20:00.788515 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-13ecb0f5-1334-4c06-9f5f-1df1b6a99b4a tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:20:00.789327 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-13ecb0f5-1334-4c06-9f5f-1df1b6a99b4a tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: edc7a08a-180f-4907-9f8d-9d14bd9cf10c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:20:00.796364 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-13ecb0f5-1334-4c06-9f5f-1df1b6a99b4a tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:20:00.796861 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-13ecb0f5-1334-4c06-9f5f-1df1b6a99b4a tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:20:00.797956 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-13ecb0f5-1334-4c06-9f5f-1df1b6a99b4a tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:20:00.798555 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-13ecb0f5-1334-4c06-9f5f-1df1b6a99b4a tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:20:00.821293 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-3dc4206a-99ad-484e-a6ca-18ae88c76793 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:20:00.822486 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-3dc4206a-99ad-484e-a6ca-18ae88c76793 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:20:00.833308 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-3dc4206a-99ad-484e-a6ca-18ae88c76793 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:20:00.834062 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-3dc4206a-99ad-484e-a6ca-18ae88c76793 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:20:00.835371 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-3dc4206a-99ad-484e-a6ca-18ae88c76793 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:20:00.836084 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-3dc4206a-99ad-484e-a6ca-18ae88c76793 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:20:00.992969 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-13ecb0f5-1334-4c06-9f5f-1df1b6a99b4a tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:20:01.001281 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-13ecb0f5-1334-4c06-9f5f-1df1b6a99b4a tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/edc7a08a-180f-4907-9f8d-9d14bd9cf10c" status: 200 len: 1362 microversion: 2.1 time: 0.219663 Jul 22 11:20:01.001873 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 384/754] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:20:00 2022] GET /compute/v2.1/servers/edc7a08a-180f-4907-9f8d-9d14bd9cf10c => generated 1362 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:20:01.378033 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-9bdd622a-1847-476d-98c8-5ea12de0844e tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:20:01.379137 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-9bdd622a-1847-476d-98c8-5ea12de0844e tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 27286438-bce0-447c-9406-2d776cc7c81d] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:20:01.385819 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9bdd622a-1847-476d-98c8-5ea12de0844e tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:20:01.386273 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9bdd622a-1847-476d-98c8-5ea12de0844e tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:20:01.387055 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9bdd622a-1847-476d-98c8-5ea12de0844e tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:20:01.387825 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9bdd622a-1847-476d-98c8-5ea12de0844e tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:20:01.419915 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-3dc4206a-99ad-484e-a6ca-18ae88c76793 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:20:01.428599 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-3dc4206a-99ad-484e-a6ca-18ae88c76793 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:20:01.430133 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-3dc4206a-99ad-484e-a6ca-18ae88c76793 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:20:01.431946 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-3dc4206a-99ad-484e-a6ca-18ae88c76793 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46" status: 200 len: 1407 microversion: 2.20 time: 0.617730 Jul 22 11:20:01.432974 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 371/755] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:20:00 2022] GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 => generated 1407 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:20:01.594587 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-9bdd622a-1847-476d-98c8-5ea12de0844e tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:20:01.604050 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-9bdd622a-1847-476d-98c8-5ea12de0844e tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/27286438-bce0-447c-9406-2d776cc7c81d" status: 200 len: 1366 microversion: 2.1 time: 0.229863 Jul 22 11:20:01.606557 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 385/756] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:20:01 2022] GET /compute/v2.1/servers/27286438-bce0-447c-9406-2d776cc7c81d => generated 1366 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:20:02.021548 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-aa1aefbd-6c4a-4729-b79b-274fe1fbfb3c tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:20:02.022844 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-aa1aefbd-6c4a-4729-b79b-274fe1fbfb3c tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: edc7a08a-180f-4907-9f8d-9d14bd9cf10c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:20:02.033493 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-aa1aefbd-6c4a-4729-b79b-274fe1fbfb3c tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:20:02.035759 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-aa1aefbd-6c4a-4729-b79b-274fe1fbfb3c tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:20:02.037253 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-aa1aefbd-6c4a-4729-b79b-274fe1fbfb3c tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:20:02.037952 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-aa1aefbd-6c4a-4729-b79b-274fe1fbfb3c tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:20:02.145156 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [req-e1b75fc1-139b-44f9-8b84-f2871527c302 req-c216fe17-b360-44f5-b12b-3f4324b29f6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edc7a08a-180f-4907-9f8d-9d14bd9cf10c", "name": "network-vif-plugged", "status": "completed", "tag": "bf7a4ec0-a612-481f-81ec-02d77677b359"}]} {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:20:02.156420 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-e1b75fc1-139b-44f9-8b84-f2871527c302 req-c216fe17-b360-44f5-b12b-3f4324b29f6b service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:20:02.157408 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-e1b75fc1-139b-44f9-8b84-f2871527c302 req-c216fe17-b360-44f5-b12b-3f4324b29f6b service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:20:02.180484 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.compute.server_external_events [req-e1b75fc1-139b-44f9-8b84-f2871527c302 req-c216fe17-b360-44f5-b12b-3f4324b29f6b service nova] Creating event network-vif-plugged:bf7a4ec0-a612-481f-81ec-02d77677b359 for instance edc7a08a-180f-4907-9f8d-9d14bd9cf10c on hv-cinder-84890 Jul 22 11:20:02.189317 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [req-e1b75fc1-139b-44f9-8b84-f2871527c302 req-c216fe17-b360-44f5-b12b-3f4324b29f6b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.268309 Jul 22 11:20:02.192292 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 372/757] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:20:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:20:02.442066 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-aa1aefbd-6c4a-4729-b79b-274fe1fbfb3c tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:20:02.450393 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-a5f50645-1b5e-4f44-8d51-14f6efd7d39f tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:20:02.451086 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-a5f50645-1b5e-4f44-8d51-14f6efd7d39f tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:20:02.469061 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-a5f50645-1b5e-4f44-8d51-14f6efd7d39f tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:20:02.469509 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-a5f50645-1b5e-4f44-8d51-14f6efd7d39f tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:20:02.470458 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-a5f50645-1b5e-4f44-8d51-14f6efd7d39f tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:20:02.470869 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-aa1aefbd-6c4a-4729-b79b-274fe1fbfb3c tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/edc7a08a-180f-4907-9f8d-9d14bd9cf10c" status: 200 len: 1362 microversion: 2.1 time: 0.452961 Jul 22 11:20:02.471045 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-a5f50645-1b5e-4f44-8d51-14f6efd7d39f tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:20:02.483925 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 386/758] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:20:02 2022] GET /compute/v2.1/servers/edc7a08a-180f-4907-9f8d-9d14bd9cf10c => generated 1362 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:20:02.622326 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-73fd6f74-50f2-4360-bdba-9c269a9e76ed tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:20:02.623283 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-73fd6f74-50f2-4360-bdba-9c269a9e76ed tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 27286438-bce0-447c-9406-2d776cc7c81d] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:20:02.629784 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-73fd6f74-50f2-4360-bdba-9c269a9e76ed tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:20:02.630715 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-73fd6f74-50f2-4360-bdba-9c269a9e76ed tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:20:02.631782 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-73fd6f74-50f2-4360-bdba-9c269a9e76ed tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:20:02.632400 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-73fd6f74-50f2-4360-bdba-9c269a9e76ed tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:20:02.793172 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-73fd6f74-50f2-4360-bdba-9c269a9e76ed tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:20:02.803499 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-73fd6f74-50f2-4360-bdba-9c269a9e76ed tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/27286438-bce0-447c-9406-2d776cc7c81d" status: 200 len: 1366 microversion: 2.1 time: 0.185282 Jul 22 11:20:02.804100 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 387/759] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:20:02 2022] GET /compute/v2.1/servers/27286438-bce0-447c-9406-2d776cc7c81d => generated 1366 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:20:02.818893 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-a5f50645-1b5e-4f44-8d51-14f6efd7d39f tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:20:02.837120 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-a5f50645-1b5e-4f44-8d51-14f6efd7d39f tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:20:02.838636 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-a5f50645-1b5e-4f44-8d51-14f6efd7d39f tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:20:02.839818 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-a5f50645-1b5e-4f44-8d51-14f6efd7d39f tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46" status: 200 len: 1407 microversion: 2.20 time: 0.393833 Jul 22 11:20:02.840386 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 373/760] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:20:02 2022] GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 => generated 1407 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 22 11:20:02.867167 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-311e9108-b2dc-46bf-98fc-130f144575e1 req-ef5885d6-d1b5-4e0e-89ac-8e4b0e707a77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27286438-bce0-447c-9406-2d776cc7c81d", "tag": "af37cf80-6a03-4866-87c0-372fd391424e"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:20:02.886297 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-311e9108-b2dc-46bf-98fc-130f144575e1 req-ef5885d6-d1b5-4e0e-89ac-8e4b0e707a77 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:20:02.886747 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-311e9108-b2dc-46bf-98fc-130f144575e1 req-ef5885d6-d1b5-4e0e-89ac-8e4b0e707a77 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:20:02.911218 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-311e9108-b2dc-46bf-98fc-130f144575e1 req-ef5885d6-d1b5-4e0e-89ac-8e4b0e707a77 service nova] Creating event network-changed:af37cf80-6a03-4866-87c0-372fd391424e for instance 27286438-bce0-447c-9406-2d776cc7c81d on hv-cinder-84890 Jul 22 11:20:02.924031 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-311e9108-b2dc-46bf-98fc-130f144575e1 req-ef5885d6-d1b5-4e0e-89ac-8e4b0e707a77 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061971 Jul 22 11:20:02.925823 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 388/761] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:20:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:20:03.490283 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-3642ab24-75fb-4ffa-ae41-9c679e6248d6 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:20:03.493847 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-3642ab24-75fb-4ffa-ae41-9c679e6248d6 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: edc7a08a-180f-4907-9f8d-9d14bd9cf10c] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:20:03.501048 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-3642ab24-75fb-4ffa-ae41-9c679e6248d6 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:20:03.501495 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-3642ab24-75fb-4ffa-ae41-9c679e6248d6 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:20:03.502269 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-3642ab24-75fb-4ffa-ae41-9c679e6248d6 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:20:03.502693 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-3642ab24-75fb-4ffa-ae41-9c679e6248d6 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:20:03.827964 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-aa3c4b28-295b-424d-96b4-38387a267f0c tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:20:03.829401 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-aa3c4b28-295b-424d-96b4-38387a267f0c tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 27286438-bce0-447c-9406-2d776cc7c81d] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:20:03.839862 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-aa3c4b28-295b-424d-96b4-38387a267f0c tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:20:03.840394 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-aa3c4b28-295b-424d-96b4-38387a267f0c tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:20:03.841889 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-aa3c4b28-295b-424d-96b4-38387a267f0c tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:20:03.842446 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-aa3c4b28-295b-424d-96b4-38387a267f0c tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:20:03.854784 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-3642ab24-75fb-4ffa-ae41-9c679e6248d6 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:20:03.870181 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-3642ab24-75fb-4ffa-ae41-9c679e6248d6 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/edc7a08a-180f-4907-9f8d-9d14bd9cf10c" status: 200 len: 1362 microversion: 2.1 time: 0.383603 Jul 22 11:20:03.883854 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 374/762] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:20:03 2022] GET /compute/v2.1/servers/edc7a08a-180f-4907-9f8d-9d14bd9cf10c => generated 1362 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:20:03.883854 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-41174bfc-970e-43fd-949a-723ba25e07e3 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:20:03.883854 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-41174bfc-970e-43fd-949a-723ba25e07e3 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:20:03.892391 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-41174bfc-970e-43fd-949a-723ba25e07e3 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:20:03.892979 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-41174bfc-970e-43fd-949a-723ba25e07e3 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:20:03.893902 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-41174bfc-970e-43fd-949a-723ba25e07e3 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:20:03.894443 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-41174bfc-970e-43fd-949a-723ba25e07e3 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:20:04.053682 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-aa3c4b28-295b-424d-96b4-38387a267f0c tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:20:04.061643 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-aa3c4b28-295b-424d-96b4-38387a267f0c tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/27286438-bce0-447c-9406-2d776cc7c81d" status: 200 len: 1366 microversion: 2.1 time: 0.244578 Jul 22 11:20:04.062859 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 389/763] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:20:03 2022] GET /compute/v2.1/servers/27286438-bce0-447c-9406-2d776cc7c81d => generated 1366 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:20:04.118380 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-41174bfc-970e-43fd-949a-723ba25e07e3 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:20:04.135651 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-41174bfc-970e-43fd-949a-723ba25e07e3 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:20:04.137558 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-41174bfc-970e-43fd-949a-723ba25e07e3 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:20:04.138862 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-41174bfc-970e-43fd-949a-723ba25e07e3 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46" status: 200 len: 1407 microversion: 2.20 time: 0.262809 Jul 22 11:20:04.139832 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 375/764] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:20:03 2022] GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 => generated 1407 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:20:04.211128 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-75cca82d-43a8-4e03-a304-0d16a3cbd5aa req-0ed87c1b-9c59-420b-a954-424800740217 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46", "name": "network-vif-plugged", "status": "completed", "tag": "c1ac6e13-743e-4cd7-b970-2f05998ba958"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:20:04.221484 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-75cca82d-43a8-4e03-a304-0d16a3cbd5aa req-0ed87c1b-9c59-420b-a954-424800740217 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:20:04.222172 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-75cca82d-43a8-4e03-a304-0d16a3cbd5aa req-0ed87c1b-9c59-420b-a954-424800740217 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:20:04.235013 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-75cca82d-43a8-4e03-a304-0d16a3cbd5aa req-0ed87c1b-9c59-420b-a954-424800740217 service nova] Creating event network-vif-plugged:c1ac6e13-743e-4cd7-b970-2f05998ba958 for instance f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 on hv-cinder-84890 Jul 22 11:20:04.241035 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-75cca82d-43a8-4e03-a304-0d16a3cbd5aa req-0ed87c1b-9c59-420b-a954-424800740217 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034222 Jul 22 11:20:04.241762 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 390/765] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:20:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:20:04.891046 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-f0921035-f8ff-42f7-a0db-7e845c00013b tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:20:04.891818 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-f0921035-f8ff-42f7-a0db-7e845c00013b tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: edc7a08a-180f-4907-9f8d-9d14bd9cf10c] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:20:04.899194 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f0921035-f8ff-42f7-a0db-7e845c00013b tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:20:04.900091 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f0921035-f8ff-42f7-a0db-7e845c00013b tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:20:04.901573 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f0921035-f8ff-42f7-a0db-7e845c00013b tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:20:04.901573 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f0921035-f8ff-42f7-a0db-7e845c00013b tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:20:05.080181 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-55a87bce-83c8-4b8e-93d7-4ab786c98bde tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:20:05.081537 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-55a87bce-83c8-4b8e-93d7-4ab786c98bde tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 27286438-bce0-447c-9406-2d776cc7c81d] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:20:05.088423 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-55a87bce-83c8-4b8e-93d7-4ab786c98bde tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:20:05.088862 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-55a87bce-83c8-4b8e-93d7-4ab786c98bde tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:20:05.089676 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-55a87bce-83c8-4b8e-93d7-4ab786c98bde tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:20:05.090048 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-55a87bce-83c8-4b8e-93d7-4ab786c98bde tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:20:05.386918 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-f0921035-f8ff-42f7-a0db-7e845c00013b tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:20:05.400387 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-f0921035-f8ff-42f7-a0db-7e845c00013b tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/edc7a08a-180f-4907-9f8d-9d14bd9cf10c" status: 200 len: 1548 microversion: 2.1 time: 0.513206 Jul 22 11:20:05.404326 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 376/766] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:20:04 2022] GET /compute/v2.1/servers/edc7a08a-180f-4907-9f8d-9d14bd9cf10c => generated 1548 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:20:05.424444 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-f524faa2-b529-43b6-b12d-48ca1d016b51 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:20:05.425161 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-f524faa2-b529-43b6-b12d-48ca1d016b51 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:20:05.435806 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f524faa2-b529-43b6-b12d-48ca1d016b51 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:20:05.436315 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f524faa2-b529-43b6-b12d-48ca1d016b51 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:20:05.437149 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f524faa2-b529-43b6-b12d-48ca1d016b51 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:20:05.437788 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f524faa2-b529-43b6-b12d-48ca1d016b51 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:20:05.493995 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-55a87bce-83c8-4b8e-93d7-4ab786c98bde tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:20:05.503935 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-55a87bce-83c8-4b8e-93d7-4ab786c98bde tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/27286438-bce0-447c-9406-2d776cc7c81d" status: 200 len: 1366 microversion: 2.1 time: 0.426676 Jul 22 11:20:05.507032 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 391/767] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:20:05 2022] GET /compute/v2.1/servers/27286438-bce0-447c-9406-2d776cc7c81d => generated 1366 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:20:05.517477 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-7c411820-ef51-4097-85da-dc70744c101b tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:20:05.518291 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-7c411820-ef51-4097-85da-dc70744c101b tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: edc7a08a-180f-4907-9f8d-9d14bd9cf10c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:20:05.526256 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7c411820-ef51-4097-85da-dc70744c101b tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:20:05.526725 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7c411820-ef51-4097-85da-dc70744c101b tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:20:05.527535 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7c411820-ef51-4097-85da-dc70744c101b tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:20:05.528289 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7c411820-ef51-4097-85da-dc70744c101b tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:20:05.608262 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-f524faa2-b529-43b6-b12d-48ca1d016b51 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:20:05.617598 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-f524faa2-b529-43b6-b12d-48ca1d016b51 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:20:05.619238 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-f524faa2-b529-43b6-b12d-48ca1d016b51 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:20:05.620713 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-f524faa2-b529-43b6-b12d-48ca1d016b51 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46" status: 200 len: 1407 microversion: 2.20 time: 0.215075 Jul 22 11:20:05.621293 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 377/768] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:20:05 2022] GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 => generated 1407 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:20:05.669571 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-7c411820-ef51-4097-85da-dc70744c101b tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/edc7a08a-180f-4907-9f8d-9d14bd9cf10c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.160749 Jul 22 11:20:05.677798 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 392/769] 10.222.0.20 () {58 vars in 1274 bytes} [Fri Jul 22 11:20:05 2022] GET /compute/v2.1/servers/edc7a08a-180f-4907-9f8d-9d14bd9cf10c/os-interface => generated 284 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:20:06.526762 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-ea81981c-7a37-44c9-a5a1-e5439287e66a tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:20:06.527513 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-ea81981c-7a37-44c9-a5a1-e5439287e66a tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 27286438-bce0-447c-9406-2d776cc7c81d] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:20:06.529912 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG dbcounter [-] [117884] Writing DB stats nova_cell0:SELECT=2 {{(pid=117884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:20:06.538760 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-ea81981c-7a37-44c9-a5a1-e5439287e66a tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:20:06.539845 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-ea81981c-7a37-44c9-a5a1-e5439287e66a tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:20:06.541309 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-ea81981c-7a37-44c9-a5a1-e5439287e66a tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:20:06.542455 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-ea81981c-7a37-44c9-a5a1-e5439287e66a tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:20:06.640011 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-905504a9-9d35-48e4-b0f9-0df2a113f8ec tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:20:06.640580 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-905504a9-9d35-48e4-b0f9-0df2a113f8ec tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:20:06.646965 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-905504a9-9d35-48e4-b0f9-0df2a113f8ec tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:20:06.647447 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-905504a9-9d35-48e4-b0f9-0df2a113f8ec tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:20:06.648407 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-905504a9-9d35-48e4-b0f9-0df2a113f8ec tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:20:06.649011 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-905504a9-9d35-48e4-b0f9-0df2a113f8ec tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:20:06.780877 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-ea81981c-7a37-44c9-a5a1-e5439287e66a tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:20:06.791237 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-ea81981c-7a37-44c9-a5a1-e5439287e66a tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/27286438-bce0-447c-9406-2d776cc7c81d" status: 200 len: 1366 microversion: 2.1 time: 0.267801 Jul 22 11:20:06.792419 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 378/770] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:20:06 2022] GET /compute/v2.1/servers/27286438-bce0-447c-9406-2d776cc7c81d => generated 1366 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:20:06.845041 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-905504a9-9d35-48e4-b0f9-0df2a113f8ec tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:20:06.853829 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-905504a9-9d35-48e4-b0f9-0df2a113f8ec tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:20:06.855555 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-905504a9-9d35-48e4-b0f9-0df2a113f8ec tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:20:06.856877 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-905504a9-9d35-48e4-b0f9-0df2a113f8ec tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46" status: 200 len: 1407 microversion: 2.20 time: 0.221164 Jul 22 11:20:06.876583 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 393/771] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:20:06 2022] GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 => generated 1407 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 22 11:20:06.947089 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [req-175eec50-90c8-416a-be24-3c328a00421e req-8ac5e7f4-cb7c-4257-8d27-886ef43570d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edc7a08a-180f-4907-9f8d-9d14bd9cf10c", "tag": "bf7a4ec0-a612-481f-81ec-02d77677b359"}]} {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:20:06.958802 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-175eec50-90c8-416a-be24-3c328a00421e req-8ac5e7f4-cb7c-4257-8d27-886ef43570d4 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:20:06.959248 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-175eec50-90c8-416a-be24-3c328a00421e req-8ac5e7f4-cb7c-4257-8d27-886ef43570d4 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:20:06.978275 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.compute.server_external_events [req-175eec50-90c8-416a-be24-3c328a00421e req-8ac5e7f4-cb7c-4257-8d27-886ef43570d4 service nova] Creating event network-changed:bf7a4ec0-a612-481f-81ec-02d77677b359 for instance edc7a08a-180f-4907-9f8d-9d14bd9cf10c on hv-cinder-84890 Jul 22 11:20:06.985659 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [req-175eec50-90c8-416a-be24-3c328a00421e req-8ac5e7f4-cb7c-4257-8d27-886ef43570d4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042626 Jul 22 11:20:06.987406 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 379/772] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:20:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 22 11:20:07.811535 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-a0861ca0-846e-4949-8306-b307951ff522 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:20:07.812963 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-a0861ca0-846e-4949-8306-b307951ff522 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 27286438-bce0-447c-9406-2d776cc7c81d] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:20:07.834265 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell0:SELECT=2 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:20:07.835093 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell0:SELECT=24 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:20:07.839400 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a0861ca0-846e-4949-8306-b307951ff522 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:20:07.840071 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a0861ca0-846e-4949-8306-b307951ff522 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:20:07.841034 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a0861ca0-846e-4949-8306-b307951ff522 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:20:07.841640 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a0861ca0-846e-4949-8306-b307951ff522 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:20:07.879666 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-aa5d561c-75d8-41b6-8118-07e3563d2710 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:20:07.880663 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-aa5d561c-75d8-41b6-8118-07e3563d2710 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:20:07.890453 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-aa5d561c-75d8-41b6-8118-07e3563d2710 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:20:07.894278 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-aa5d561c-75d8-41b6-8118-07e3563d2710 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:20:07.896123 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-aa5d561c-75d8-41b6-8118-07e3563d2710 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:20:07.899497 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-aa5d561c-75d8-41b6-8118-07e3563d2710 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:20:07.931750 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG dbcounter [-] [117884] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=117884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:20:08.029890 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG dbcounter [-] [117884] Writing DB stats nova_cell0:SELECT=12 {{(pid=117884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:20:08.076322 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-a0861ca0-846e-4949-8306-b307951ff522 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:20:08.084852 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-a0861ca0-846e-4949-8306-b307951ff522 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/27286438-bce0-447c-9406-2d776cc7c81d" status: 200 len: 1366 microversion: 2.1 time: 0.278576 Jul 22 11:20:08.085469 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 394/773] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:20:07 2022] GET /compute/v2.1/servers/27286438-bce0-447c-9406-2d776cc7c81d => generated 1366 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:20:08.200290 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-aa5d561c-75d8-41b6-8118-07e3563d2710 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:20:08.214046 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-aa5d561c-75d8-41b6-8118-07e3563d2710 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:20:08.216746 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-aa5d561c-75d8-41b6-8118-07e3563d2710 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:20:08.218410 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-aa5d561c-75d8-41b6-8118-07e3563d2710 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46" status: 200 len: 1599 microversion: 2.20 time: 0.343861 Jul 22 11:20:08.219048 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 380/774] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:20:07 2022] GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 => generated 1599 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 22 11:20:08.244909 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-c27f5a87-9850-4a7b-9769-44d7fe103484 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:20:08.245857 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-c27f5a87-9850-4a7b-9769-44d7fe103484 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:20:08.260543 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c27f5a87-9850-4a7b-9769-44d7fe103484 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:20:08.261425 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c27f5a87-9850-4a7b-9769-44d7fe103484 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:20:08.262640 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c27f5a87-9850-4a7b-9769-44d7fe103484 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:20:08.263333 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c27f5a87-9850-4a7b-9769-44d7fe103484 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:20:08.631704 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-c27f5a87-9850-4a7b-9769-44d7fe103484 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.391830 Jul 22 11:20:08.632514 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 395/775] 10.222.0.20 () {60 vars in 1315 bytes} [Fri Jul 22 11:20:08 2022] GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46/os-interface => generated 284 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 22 11:20:09.106078 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-6adfc00a-fed7-4e76-93c4-53a25a5c394e tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:20:09.106875 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-6adfc00a-fed7-4e76-93c4-53a25a5c394e tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 27286438-bce0-447c-9406-2d776cc7c81d] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:20:09.113630 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-6adfc00a-fed7-4e76-93c4-53a25a5c394e tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:20:09.114075 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-6adfc00a-fed7-4e76-93c4-53a25a5c394e tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:20:09.116168 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-6adfc00a-fed7-4e76-93c4-53a25a5c394e tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:20:09.116168 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-6adfc00a-fed7-4e76-93c4-53a25a5c394e tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:20:09.267565 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-6adfc00a-fed7-4e76-93c4-53a25a5c394e tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:20:09.278255 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-6adfc00a-fed7-4e76-93c4-53a25a5c394e tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/27286438-bce0-447c-9406-2d776cc7c81d" status: 200 len: 1366 microversion: 2.1 time: 0.175983 Jul 22 11:20:09.279069 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 381/776] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:20:09 2022] GET /compute/v2.1/servers/27286438-bce0-447c-9406-2d776cc7c81d => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:20:09.743094 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-a571d266-9c70-4619-baba-c41805c71fa5 req-c76c5a81-de35-4202-b701-4266405400e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27286438-bce0-447c-9406-2d776cc7c81d", "name": "network-vif-plugged", "status": "completed", "tag": "af37cf80-6a03-4866-87c0-372fd391424e"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:20:09.753891 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-a571d266-9c70-4619-baba-c41805c71fa5 req-c76c5a81-de35-4202-b701-4266405400e4 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:20:09.754606 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-a571d266-9c70-4619-baba-c41805c71fa5 req-c76c5a81-de35-4202-b701-4266405400e4 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:20:09.768098 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-a571d266-9c70-4619-baba-c41805c71fa5 req-c76c5a81-de35-4202-b701-4266405400e4 service nova] Creating event network-vif-plugged:af37cf80-6a03-4866-87c0-372fd391424e for instance 27286438-bce0-447c-9406-2d776cc7c81d on hv-cinder-84890 Jul 22 11:20:09.777054 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-a571d266-9c70-4619-baba-c41805c71fa5 req-c76c5a81-de35-4202-b701-4266405400e4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036576 Jul 22 11:20:09.778501 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 396/777] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:20:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:20:10.018444 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [req-9362e563-6a8a-4058-8508-a6bed0b2a6a8 req-7de9bc4d-4437-428b-b17b-3546648c01f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46", "tag": "c1ac6e13-743e-4cd7-b970-2f05998ba958"}]} {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:20:10.024518 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG dbcounter [-] [117884] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=117884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:20:10.033782 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-9362e563-6a8a-4058-8508-a6bed0b2a6a8 req-7de9bc4d-4437-428b-b17b-3546648c01f6 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:20:10.034570 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-9362e563-6a8a-4058-8508-a6bed0b2a6a8 req-7de9bc4d-4437-428b-b17b-3546648c01f6 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:20:10.048220 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.compute.server_external_events [req-9362e563-6a8a-4058-8508-a6bed0b2a6a8 req-7de9bc4d-4437-428b-b17b-3546648c01f6 service nova] Creating event network-changed:c1ac6e13-743e-4cd7-b970-2f05998ba958 for instance f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 on hv-cinder-84890 Jul 22 11:20:10.057611 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [req-9362e563-6a8a-4058-8508-a6bed0b2a6a8 req-7de9bc4d-4437-428b-b17b-3546648c01f6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045103 Jul 22 11:20:10.060101 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 382/778] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:20:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:20:10.299521 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-3a5bb743-7039-4ca1-a52e-a826e18a2bfc tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:20:10.300303 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-3a5bb743-7039-4ca1-a52e-a826e18a2bfc tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 27286438-bce0-447c-9406-2d776cc7c81d] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:20:10.308751 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3a5bb743-7039-4ca1-a52e-a826e18a2bfc tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:20:10.309499 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3a5bb743-7039-4ca1-a52e-a826e18a2bfc tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:20:10.310526 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3a5bb743-7039-4ca1-a52e-a826e18a2bfc tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:20:10.311120 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3a5bb743-7039-4ca1-a52e-a826e18a2bfc tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:20:10.517643 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-3a5bb743-7039-4ca1-a52e-a826e18a2bfc tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:20:10.526775 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-3a5bb743-7039-4ca1-a52e-a826e18a2bfc tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/27286438-bce0-447c-9406-2d776cc7c81d" status: 200 len: 1366 microversion: 2.1 time: 0.234035 Jul 22 11:20:10.537279 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 397/779] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:20:10 2022] GET /compute/v2.1/servers/27286438-bce0-447c-9406-2d776cc7c81d => generated 1366 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:20:11.548619 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-9b712649-8a66-4c86-9dd9-32eb0b61605a tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:20:11.549780 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-9b712649-8a66-4c86-9dd9-32eb0b61605a tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 27286438-bce0-447c-9406-2d776cc7c81d] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:20:11.569359 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-9b712649-8a66-4c86-9dd9-32eb0b61605a tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:20:11.569800 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-9b712649-8a66-4c86-9dd9-32eb0b61605a tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:20:11.579040 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-9b712649-8a66-4c86-9dd9-32eb0b61605a tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:20:11.580275 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-9b712649-8a66-4c86-9dd9-32eb0b61605a tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:20:11.801490 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-9b712649-8a66-4c86-9dd9-32eb0b61605a tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:20:11.809777 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-9b712649-8a66-4c86-9dd9-32eb0b61605a tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/27286438-bce0-447c-9406-2d776cc7c81d" status: 200 len: 1366 microversion: 2.1 time: 0.268018 Jul 22 11:20:11.810507 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 383/780] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:20:11 2022] GET /compute/v2.1/servers/27286438-bce0-447c-9406-2d776cc7c81d => generated 1366 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:20:12.826993 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-ca13e8d4-a767-4597-be16-35976ce3bac4 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:20:12.827624 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-ca13e8d4-a767-4597-be16-35976ce3bac4 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 27286438-bce0-447c-9406-2d776cc7c81d] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:20:12.834122 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ca13e8d4-a767-4597-be16-35976ce3bac4 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:20:12.834564 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ca13e8d4-a767-4597-be16-35976ce3bac4 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:20:12.835335 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ca13e8d4-a767-4597-be16-35976ce3bac4 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:20:12.835765 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ca13e8d4-a767-4597-be16-35976ce3bac4 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:20:12.965796 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-ca13e8d4-a767-4597-be16-35976ce3bac4 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:20:12.969335 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=100 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:20:12.974829 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-ca13e8d4-a767-4597-be16-35976ce3bac4 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/27286438-bce0-447c-9406-2d776cc7c81d" status: 200 len: 1556 microversion: 2.1 time: 0.151744 Jul 22 11:20:12.975412 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 398/781] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:20:12 2022] GET /compute/v2.1/servers/27286438-bce0-447c-9406-2d776cc7c81d => generated 1556 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:20:12.991709 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-714f0e7c-cac7-4ac7-9bb1-d6da8297af92 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:20:12.992416 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-714f0e7c-cac7-4ac7-9bb1-d6da8297af92 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 27286438-bce0-447c-9406-2d776cc7c81d] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:20:12.998575 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-714f0e7c-cac7-4ac7-9bb1-d6da8297af92 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:20:12.999021 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-714f0e7c-cac7-4ac7-9bb1-d6da8297af92 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:20:12.999886 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-714f0e7c-cac7-4ac7-9bb1-d6da8297af92 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:20:13.000322 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-714f0e7c-cac7-4ac7-9bb1-d6da8297af92 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:20:13.088110 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-714f0e7c-cac7-4ac7-9bb1-d6da8297af92 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/27286438-bce0-447c-9406-2d776cc7c81d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101097 Jul 22 11:20:13.088715 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 384/782] 10.222.0.20 () {58 vars in 1274 bytes} [Fri Jul 22 11:20:12 2022] GET /compute/v2.1/servers/27286438-bce0-447c-9406-2d776cc7c81d/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:20:14.398079 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-c54c5da2-9c80-4d8d-92f0-9bd4d2377ca0 req-30fc0b38-2b5c-4965-bc59-8fd17ae309ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27286438-bce0-447c-9406-2d776cc7c81d", "tag": "af37cf80-6a03-4866-87c0-372fd391424e"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:20:14.407248 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-c54c5da2-9c80-4d8d-92f0-9bd4d2377ca0 req-30fc0b38-2b5c-4965-bc59-8fd17ae309ec service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:20:14.407723 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-c54c5da2-9c80-4d8d-92f0-9bd4d2377ca0 req-30fc0b38-2b5c-4965-bc59-8fd17ae309ec service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:20:14.424794 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-c54c5da2-9c80-4d8d-92f0-9bd4d2377ca0 req-30fc0b38-2b5c-4965-bc59-8fd17ae309ec service nova] Creating event network-changed:af37cf80-6a03-4866-87c0-372fd391424e for instance 27286438-bce0-447c-9406-2d776cc7c81d on hv-cinder-84890 Jul 22 11:20:14.430502 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-c54c5da2-9c80-4d8d-92f0-9bd4d2377ca0 req-30fc0b38-2b5c-4965-bc59-8fd17ae309ec service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036341 Jul 22 11:20:14.431410 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 399/783] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:20:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 22 11:20:51.539906 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG dbcounter [-] [117884] Writing DB stats nova_api:SELECT=4 {{(pid=117884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:20:51.541062 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG dbcounter [-] [117884] Writing DB stats nova_cell1:SELECT=20 {{(pid=117884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:20:51.551794 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-de5217e2-f42e-40b3-a1b8-92c90b8153dc tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:20:51.552282 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-de5217e2-f42e-40b3-a1b8-92c90b8153dc tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: edc7a08a-180f-4907-9f8d-9d14bd9cf10c] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:20:51.560065 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-de5217e2-f42e-40b3-a1b8-92c90b8153dc tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:20:51.560465 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-de5217e2-f42e-40b3-a1b8-92c90b8153dc tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:20:51.561270 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-de5217e2-f42e-40b3-a1b8-92c90b8153dc tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:20:51.561706 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-de5217e2-f42e-40b3-a1b8-92c90b8153dc tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:20:51.588671 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-de5217e2-f42e-40b3-a1b8-92c90b8153dc tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/edc7a08a-180f-4907-9f8d-9d14bd9cf10c/ips" status: 200 len: 146 microversion: 2.1 time: 0.051214 Jul 22 11:20:51.589265 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 385/784] 10.222.0.20 () {58 vars in 1247 bytes} [Fri Jul 22 11:20:51 2022] GET /compute/v2.1/servers/edc7a08a-180f-4907-9f8d-9d14bd9cf10c/ips => generated 146 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:20:52.996422 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-f3b4af75-5b54-4ef4-8bc6-7b625ecbc609 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d17a11c3-b806-45ce-b169-f9ba29bef044"}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:20:52.997596 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-f3b4af75-5b54-4ef4-8bc6-7b625ecbc609 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: edc7a08a-180f-4907-9f8d-9d14bd9cf10c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:20:53.000385 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_api:SELECT=40 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:20:53.001049 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=2 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:20:53.007707 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f3b4af75-5b54-4ef4-8bc6-7b625ecbc609 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:20:53.008227 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f3b4af75-5b54-4ef4-8bc6-7b625ecbc609 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:20:53.009248 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f3b4af75-5b54-4ef4-8bc6-7b625ecbc609 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:20:53.009687 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f3b4af75-5b54-4ef4-8bc6-7b625ecbc609 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:20:53.294625 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-f3b4af75-5b54-4ef4-8bc6-7b625ecbc609 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "POST /compute/v2.1/servers/edc7a08a-180f-4907-9f8d-9d14bd9cf10c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.302592 Jul 22 11:20:53.295656 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 400/785] 10.222.0.20 () {60 vars in 1322 bytes} [Fri Jul 22 11:20:52 2022] POST /compute/v2.1/servers/edc7a08a-180f-4907-9f8d-9d14bd9cf10c/os-volume_attachments => generated 194 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:20:54.388673 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-3b57e4bd-5acd-4bee-88b8-2d0377763718 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:20:54.389602 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-3b57e4bd-5acd-4bee-88b8-2d0377763718 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:20:54.397370 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-3b57e4bd-5acd-4bee-88b8-2d0377763718 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:20:54.397834 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-3b57e4bd-5acd-4bee-88b8-2d0377763718 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:20:54.398629 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-3b57e4bd-5acd-4bee-88b8-2d0377763718 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:20:54.399070 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-3b57e4bd-5acd-4bee-88b8-2d0377763718 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:20:54.429343 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-3b57e4bd-5acd-4bee-88b8-2d0377763718 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46/ips" status: 200 len: 152 microversion: 2.20 time: 0.252531 Jul 22 11:20:54.430335 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 386/786] 10.222.0.20 () {60 vars in 1288 bytes} [Fri Jul 22 11:20:54 2022] GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46/ips => generated 152 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 22 11:20:56.270775 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-9d299f4e-2e90-4155-86fc-6b98357192c9 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:20:56.271425 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-9d299f4e-2e90-4155-86fc-6b98357192c9 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:20:56.278252 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9d299f4e-2e90-4155-86fc-6b98357192c9 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:20:56.278690 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9d299f4e-2e90-4155-86fc-6b98357192c9 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:20:56.279493 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9d299f4e-2e90-4155-86fc-6b98357192c9 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:20:56.279924 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9d299f4e-2e90-4155-86fc-6b98357192c9 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:20:56.307714 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.objects.instance [None req-9d299f4e-2e90-4155-86fc-6b98357192c9 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lazy-loading 'flavor' on Instance uuid f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 {{(pid=117885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 22 11:20:56.582306 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-9d299f4e-2e90-4155-86fc-6b98357192c9 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "POST /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46/action" status: 202 len: 0 microversion: 2.20 time: 0.316168 Jul 22 11:20:56.587440 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 401/787] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Jul 22 11:20:56 2022] POST /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46/action => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 22 11:20:56.593168 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-580ceb93-af4e-4eca-80d4-e82b474aacbb tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:20:56.593769 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-580ceb93-af4e-4eca-80d4-e82b474aacbb tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:20:56.600813 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-580ceb93-af4e-4eca-80d4-e82b474aacbb tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:20:56.601615 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-580ceb93-af4e-4eca-80d4-e82b474aacbb tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:20:56.602914 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-580ceb93-af4e-4eca-80d4-e82b474aacbb tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:20:56.603595 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-580ceb93-af4e-4eca-80d4-e82b474aacbb tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:20:56.755182 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-580ceb93-af4e-4eca-80d4-e82b474aacbb tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:20:56.765138 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-580ceb93-af4e-4eca-80d4-e82b474aacbb tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:20:56.766809 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-580ceb93-af4e-4eca-80d4-e82b474aacbb tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:20:56.768183 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-580ceb93-af4e-4eca-80d4-e82b474aacbb tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46" status: 200 len: 1724 microversion: 2.20 time: 0.178784 Jul 22 11:20:56.769132 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 387/788] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:20:56 2022] GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:20:57.790264 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-3216140e-c12c-48c0-be65-a5926214f02d tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:20:57.790963 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-3216140e-c12c-48c0-be65-a5926214f02d tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:20:57.797679 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3216140e-c12c-48c0-be65-a5926214f02d tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:20:57.798127 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3216140e-c12c-48c0-be65-a5926214f02d tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:20:57.798904 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3216140e-c12c-48c0-be65-a5926214f02d tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:20:57.799379 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3216140e-c12c-48c0-be65-a5926214f02d tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:20:57.941244 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-3216140e-c12c-48c0-be65-a5926214f02d tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:20:57.949670 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-3216140e-c12c-48c0-be65-a5926214f02d tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:20:57.951205 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-3216140e-c12c-48c0-be65-a5926214f02d tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:20:57.952446 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-3216140e-c12c-48c0-be65-a5926214f02d tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46" status: 200 len: 1724 microversion: 2.20 time: 0.167137 Jul 22 11:20:57.953022 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 402/789] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:20:57 2022] GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:20:57.960677 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-6e0bfa16-7489-41a3-bf60-94af32f9bdd9 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:20:57.961248 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-6e0bfa16-7489-41a3-bf60-94af32f9bdd9 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 27286438-bce0-447c-9406-2d776cc7c81d] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:20:57.967634 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-6e0bfa16-7489-41a3-bf60-94af32f9bdd9 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:20:57.968072 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-6e0bfa16-7489-41a3-bf60-94af32f9bdd9 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:20:57.969517 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-6e0bfa16-7489-41a3-bf60-94af32f9bdd9 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:20:57.969517 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-6e0bfa16-7489-41a3-bf60-94af32f9bdd9 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:20:57.993766 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-6e0bfa16-7489-41a3-bf60-94af32f9bdd9 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/27286438-bce0-447c-9406-2d776cc7c81d/ips" status: 200 len: 150 microversion: 2.1 time: 0.037817 Jul 22 11:20:57.994363 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 388/790] 10.222.0.20 () {58 vars in 1247 bytes} [Fri Jul 22 11:20:57 2022] GET /compute/v2.1/servers/27286438-bce0-447c-9406-2d776cc7c81d/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:20:58.970834 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-28974319-d169-48e4-9228-080bf7103917 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:20:58.971638 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-28974319-d169-48e4-9228-080bf7103917 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:20:58.979086 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-28974319-d169-48e4-9228-080bf7103917 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:20:58.979557 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-28974319-d169-48e4-9228-080bf7103917 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:20:58.980352 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-28974319-d169-48e4-9228-080bf7103917 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:20:58.980780 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-28974319-d169-48e4-9228-080bf7103917 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:20:59.117868 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-28974319-d169-48e4-9228-080bf7103917 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:20:59.125920 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-28974319-d169-48e4-9228-080bf7103917 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:20:59.127418 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-28974319-d169-48e4-9228-080bf7103917 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:20:59.128611 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-28974319-d169-48e4-9228-080bf7103917 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46" status: 200 len: 1724 microversion: 2.20 time: 0.161876 Jul 22 11:20:59.129168 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 403/791] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:20:58 2022] GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:21:00.146870 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-07dcb67f-d492-495c-9ab2-5a66264bd653 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:00.147484 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-07dcb67f-d492-495c-9ab2-5a66264bd653 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:00.154120 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-07dcb67f-d492-495c-9ab2-5a66264bd653 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:00.154576 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-07dcb67f-d492-495c-9ab2-5a66264bd653 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:00.155409 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-07dcb67f-d492-495c-9ab2-5a66264bd653 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:00.155846 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-07dcb67f-d492-495c-9ab2-5a66264bd653 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:00.288260 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-07dcb67f-d492-495c-9ab2-5a66264bd653 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:00.296801 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-07dcb67f-d492-495c-9ab2-5a66264bd653 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:00.298684 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-07dcb67f-d492-495c-9ab2-5a66264bd653 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:00.299953 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-07dcb67f-d492-495c-9ab2-5a66264bd653 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46" status: 200 len: 1724 microversion: 2.20 time: 0.157071 Jul 22 11:21:00.300538 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 389/792] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:21:00 2022] GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:21:00.423576 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-2a786f50-1271-408a-b2d0-bc7126c51abc tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "078afddb-d8b8-4334-abc6-dce6b078cb9c"}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:21:00.424757 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-2a786f50-1271-408a-b2d0-bc7126c51abc tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 27286438-bce0-447c-9406-2d776cc7c81d] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:00.431822 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2a786f50-1271-408a-b2d0-bc7126c51abc tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:00.432313 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2a786f50-1271-408a-b2d0-bc7126c51abc tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:00.433089 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2a786f50-1271-408a-b2d0-bc7126c51abc tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:00.433521 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2a786f50-1271-408a-b2d0-bc7126c51abc tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:01.321803 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-658c26f2-eab2-4f46-973b-47bc00808099 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:01.322412 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-658c26f2-eab2-4f46-973b-47bc00808099 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:01.329054 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-658c26f2-eab2-4f46-973b-47bc00808099 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:01.329502 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-658c26f2-eab2-4f46-973b-47bc00808099 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:01.330274 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-658c26f2-eab2-4f46-973b-47bc00808099 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:01.330712 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-658c26f2-eab2-4f46-973b-47bc00808099 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:01.472295 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-658c26f2-eab2-4f46-973b-47bc00808099 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:01.480110 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-658c26f2-eab2-4f46-973b-47bc00808099 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:01.481599 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-658c26f2-eab2-4f46-973b-47bc00808099 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:01.482740 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-658c26f2-eab2-4f46-973b-47bc00808099 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46" status: 200 len: 1724 microversion: 2.20 time: 0.164910 Jul 22 11:21:01.483320 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 390/793] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:21:01 2022] GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 22 11:21:02.501696 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-87b191f1-60e9-4fb0-b027-f232829a88a3 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:02.502371 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-87b191f1-60e9-4fb0-b027-f232829a88a3 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:02.509426 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-87b191f1-60e9-4fb0-b027-f232829a88a3 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:02.509881 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-87b191f1-60e9-4fb0-b027-f232829a88a3 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:02.510724 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-87b191f1-60e9-4fb0-b027-f232829a88a3 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:02.511061 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-87b191f1-60e9-4fb0-b027-f232829a88a3 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:02.650307 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-87b191f1-60e9-4fb0-b027-f232829a88a3 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:02.658151 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-87b191f1-60e9-4fb0-b027-f232829a88a3 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:02.659709 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-87b191f1-60e9-4fb0-b027-f232829a88a3 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:02.660850 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-87b191f1-60e9-4fb0-b027-f232829a88a3 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46" status: 200 len: 1724 microversion: 2.20 time: 0.163229 Jul 22 11:21:02.661403 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 391/794] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:21:02 2022] GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 22 11:21:03.682141 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-dae4192d-8c3d-426d-8961-329dc47f658b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:03.683430 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-dae4192d-8c3d-426d-8961-329dc47f658b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:03.692033 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-dae4192d-8c3d-426d-8961-329dc47f658b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:03.692481 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-dae4192d-8c3d-426d-8961-329dc47f658b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:03.693253 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-dae4192d-8c3d-426d-8961-329dc47f658b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:03.693685 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-dae4192d-8c3d-426d-8961-329dc47f658b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:03.825671 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-dae4192d-8c3d-426d-8961-329dc47f658b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:03.834098 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-dae4192d-8c3d-426d-8961-329dc47f658b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:03.835629 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-dae4192d-8c3d-426d-8961-329dc47f658b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:03.836786 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-dae4192d-8c3d-426d-8961-329dc47f658b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46" status: 200 len: 1724 microversion: 2.20 time: 0.160710 Jul 22 11:21:03.837353 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 392/795] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:21:03 2022] GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:21:04.854569 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-fe18d6e8-75e5-4f5c-aad0-b556451f3bcd tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:04.855377 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-fe18d6e8-75e5-4f5c-aad0-b556451f3bcd tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:04.862851 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-fe18d6e8-75e5-4f5c-aad0-b556451f3bcd tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:04.863324 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-fe18d6e8-75e5-4f5c-aad0-b556451f3bcd tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:04.864134 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-fe18d6e8-75e5-4f5c-aad0-b556451f3bcd tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:04.864823 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-fe18d6e8-75e5-4f5c-aad0-b556451f3bcd tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:05.101387 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-fe18d6e8-75e5-4f5c-aad0-b556451f3bcd tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:05.111728 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-fe18d6e8-75e5-4f5c-aad0-b556451f3bcd tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:05.115222 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-fe18d6e8-75e5-4f5c-aad0-b556451f3bcd tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:05.116668 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-fe18d6e8-75e5-4f5c-aad0-b556451f3bcd tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46" status: 200 len: 1724 microversion: 2.20 time: 0.265779 Jul 22 11:21:05.118066 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 393/796] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:21:04 2022] GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 => generated 1724 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 22 11:21:05.217323 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-2a786f50-1271-408a-b2d0-bc7126c51abc tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "POST /compute/v2.1/servers/27286438-bce0-447c-9406-2d776cc7c81d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.798054 Jul 22 11:21:05.217921 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 404/797] 10.222.0.20 () {60 vars in 1322 bytes} [Fri Jul 22 11:21:00 2022] POST /compute/v2.1/servers/27286438-bce0-447c-9406-2d776cc7c81d/os-volume_attachments => generated 194 bytes in 4800 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:21:06.136186 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-ac2bca27-df99-4a8d-b682-15807290091d tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:06.137019 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-ac2bca27-df99-4a8d-b682-15807290091d tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:06.143863 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-ac2bca27-df99-4a8d-b682-15807290091d tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:06.144402 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-ac2bca27-df99-4a8d-b682-15807290091d tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:06.145253 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-ac2bca27-df99-4a8d-b682-15807290091d tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:06.145750 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-ac2bca27-df99-4a8d-b682-15807290091d tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:06.231710 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-ca215c9e-96ef-4499-a172-83bc737eebf9 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:06.232837 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-ca215c9e-96ef-4499-a172-83bc737eebf9 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: edc7a08a-180f-4907-9f8d-9d14bd9cf10c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:06.241455 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ca215c9e-96ef-4499-a172-83bc737eebf9 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:06.241912 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ca215c9e-96ef-4499-a172-83bc737eebf9 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:06.242850 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ca215c9e-96ef-4499-a172-83bc737eebf9 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:06.243136 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ca215c9e-96ef-4499-a172-83bc737eebf9 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:06.283037 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-ca215c9e-96ef-4499-a172-83bc737eebf9 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/edc7a08a-180f-4907-9f8d-9d14bd9cf10c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056096 Jul 22 11:21:06.284697 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 405/798] 10.222.0.20 () {58 vars in 1301 bytes} [Fri Jul 22 11:21:06 2022] GET /compute/v2.1/servers/edc7a08a-180f-4907-9f8d-9d14bd9cf10c/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 22 11:21:06.299242 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-01b4f755-27eb-4d6f-951c-33326aafd4f2 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:06.299921 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-01b4f755-27eb-4d6f-951c-33326aafd4f2 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: edc7a08a-180f-4907-9f8d-9d14bd9cf10c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:06.310508 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-01b4f755-27eb-4d6f-951c-33326aafd4f2 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:06.310972 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-01b4f755-27eb-4d6f-951c-33326aafd4f2 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:06.311796 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-01b4f755-27eb-4d6f-951c-33326aafd4f2 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:06.312232 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-01b4f755-27eb-4d6f-951c-33326aafd4f2 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:06.319644 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-ac2bca27-df99-4a8d-b682-15807290091d tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:06.336760 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-ac2bca27-df99-4a8d-b682-15807290091d tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:06.340101 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-ac2bca27-df99-4a8d-b682-15807290091d tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:06.344064 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-ac2bca27-df99-4a8d-b682-15807290091d tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46" status: 200 len: 1724 microversion: 2.20 time: 0.211293 Jul 22 11:21:06.357257 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 394/799] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:21:06 2022] GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 => generated 1724 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:21:06.363421 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-01b4f755-27eb-4d6f-951c-33326aafd4f2 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/edc7a08a-180f-4907-9f8d-9d14bd9cf10c/os-volume_attachments/d17a11c3-b806-45ce-b169-f9ba29bef044" status: 200 len: 194 microversion: 2.1 time: 0.072070 Jul 22 11:21:06.364032 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 406/800] 10.222.0.20 () {58 vars in 1412 bytes} [Fri Jul 22 11:21:06 2022] GET /compute/v2.1/servers/edc7a08a-180f-4907-9f8d-9d14bd9cf10c/os-volume_attachments/d17a11c3-b806-45ce-b169-f9ba29bef044 => generated 194 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:21:07.365006 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-3b0f90a1-203b-4c51-adc1-e554ec900006 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:07.365611 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-3b0f90a1-203b-4c51-adc1-e554ec900006 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:07.372187 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-3b0f90a1-203b-4c51-adc1-e554ec900006 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:07.372630 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-3b0f90a1-203b-4c51-adc1-e554ec900006 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:07.373570 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-3b0f90a1-203b-4c51-adc1-e554ec900006 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:07.374155 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-3b0f90a1-203b-4c51-adc1-e554ec900006 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:07.537705 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-3b0f90a1-203b-4c51-adc1-e554ec900006 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:07.547286 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-3b0f90a1-203b-4c51-adc1-e554ec900006 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:07.549248 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-3b0f90a1-203b-4c51-adc1-e554ec900006 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:07.551347 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-3b0f90a1-203b-4c51-adc1-e554ec900006 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46" status: 200 len: 1724 microversion: 2.20 time: 0.190917 Jul 22 11:21:07.552047 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 395/801] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:21:07 2022] GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 => generated 1724 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:21:07.778982 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-c1380579-4c14-4d69-8016-49fb2d25b400 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a2601b22-4e10-4313-8c99-ed90248d4871"}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:21:07.780469 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-c1380579-4c14-4d69-8016-49fb2d25b400 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: edc7a08a-180f-4907-9f8d-9d14bd9cf10c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:07.792727 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c1380579-4c14-4d69-8016-49fb2d25b400 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:07.793383 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c1380579-4c14-4d69-8016-49fb2d25b400 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:07.794146 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c1380579-4c14-4d69-8016-49fb2d25b400 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:07.794569 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c1380579-4c14-4d69-8016-49fb2d25b400 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:08.098304 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-c1380579-4c14-4d69-8016-49fb2d25b400 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "POST /compute/v2.1/servers/edc7a08a-180f-4907-9f8d-9d14bd9cf10c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.325524 Jul 22 11:21:08.098920 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 407/802] 10.222.0.20 () {60 vars in 1322 bytes} [Fri Jul 22 11:21:07 2022] POST /compute/v2.1/servers/edc7a08a-180f-4907-9f8d-9d14bd9cf10c/os-volume_attachments => generated 194 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:21:08.570275 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-b3d31edf-c389-4d5b-b48e-4043e1fc992e tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:08.570894 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-b3d31edf-c389-4d5b-b48e-4043e1fc992e tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:08.577527 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-b3d31edf-c389-4d5b-b48e-4043e1fc992e tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:08.577977 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-b3d31edf-c389-4d5b-b48e-4043e1fc992e tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:08.578806 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-b3d31edf-c389-4d5b-b48e-4043e1fc992e tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:08.579439 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-b3d31edf-c389-4d5b-b48e-4043e1fc992e tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:08.740378 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-b3d31edf-c389-4d5b-b48e-4043e1fc992e tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:08.763913 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-b3d31edf-c389-4d5b-b48e-4043e1fc992e tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:08.769586 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-b3d31edf-c389-4d5b-b48e-4043e1fc992e tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:08.771646 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-b3d31edf-c389-4d5b-b48e-4043e1fc992e tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46" status: 200 len: 1724 microversion: 2.20 time: 0.205709 Jul 22 11:21:08.783396 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 396/803] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:21:08 2022] GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 => generated 1724 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:21:09.792057 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-82fc3690-8003-40b6-8a3f-dab631aa0ecf tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:09.792758 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-82fc3690-8003-40b6-8a3f-dab631aa0ecf tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:09.800436 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-82fc3690-8003-40b6-8a3f-dab631aa0ecf tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:09.801334 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-82fc3690-8003-40b6-8a3f-dab631aa0ecf tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:09.802587 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-82fc3690-8003-40b6-8a3f-dab631aa0ecf tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:09.803245 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-82fc3690-8003-40b6-8a3f-dab631aa0ecf tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:10.131009 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-82fc3690-8003-40b6-8a3f-dab631aa0ecf tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:10.140497 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-82fc3690-8003-40b6-8a3f-dab631aa0ecf tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:10.142248 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-82fc3690-8003-40b6-8a3f-dab631aa0ecf tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:10.144153 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-82fc3690-8003-40b6-8a3f-dab631aa0ecf tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46" status: 200 len: 1724 microversion: 2.20 time: 0.357021 Jul 22 11:21:10.144717 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 408/804] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:21:09 2022] GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 => generated 1724 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:21:11.164024 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-bf6fbd96-7dfd-4d53-85db-7764f566c6bb tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:11.165608 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-bf6fbd96-7dfd-4d53-85db-7764f566c6bb tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:11.177020 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-bf6fbd96-7dfd-4d53-85db-7764f566c6bb tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:11.178162 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-bf6fbd96-7dfd-4d53-85db-7764f566c6bb tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:11.179714 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-bf6fbd96-7dfd-4d53-85db-7764f566c6bb tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:11.181137 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-bf6fbd96-7dfd-4d53-85db-7764f566c6bb tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:11.396631 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-bf6fbd96-7dfd-4d53-85db-7764f566c6bb tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:11.413770 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-bf6fbd96-7dfd-4d53-85db-7764f566c6bb tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:11.418828 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-bf6fbd96-7dfd-4d53-85db-7764f566c6bb tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:11.421248 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-bf6fbd96-7dfd-4d53-85db-7764f566c6bb tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46" status: 200 len: 1724 microversion: 2.20 time: 0.262320 Jul 22 11:21:11.432967 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 397/805] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:21:11 2022] GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 => generated 1724 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:21:12.441576 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-73fbebd0-0856-4f24-b167-54e211827a94 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:12.442188 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-73fbebd0-0856-4f24-b167-54e211827a94 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:12.449412 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-73fbebd0-0856-4f24-b167-54e211827a94 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:12.449718 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-73fbebd0-0856-4f24-b167-54e211827a94 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:12.450598 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-73fbebd0-0856-4f24-b167-54e211827a94 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:12.451207 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-73fbebd0-0856-4f24-b167-54e211827a94 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:12.734891 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-73fbebd0-0856-4f24-b167-54e211827a94 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:12.749015 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-73fbebd0-0856-4f24-b167-54e211827a94 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:12.751148 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-73fbebd0-0856-4f24-b167-54e211827a94 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:12.753380 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-73fbebd0-0856-4f24-b167-54e211827a94 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46" status: 200 len: 1724 microversion: 2.20 time: 0.317146 Jul 22 11:21:12.764899 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 409/806] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:21:12 2022] GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 => generated 1724 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:21:13.039194 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-f6643b33-d51d-4486-9be4-9b39189714ea tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:13.039763 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-f6643b33-d51d-4486-9be4-9b39189714ea tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 27286438-bce0-447c-9406-2d776cc7c81d] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:13.052814 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f6643b33-d51d-4486-9be4-9b39189714ea tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:13.053291 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f6643b33-d51d-4486-9be4-9b39189714ea tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:13.054104 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f6643b33-d51d-4486-9be4-9b39189714ea tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:13.054546 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f6643b33-d51d-4486-9be4-9b39189714ea tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:13.243652 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.objects.instance [None req-f6643b33-d51d-4486-9be4-9b39189714ea tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lazy-loading 'services' on Instance uuid 27286438-bce0-447c-9406-2d776cc7c81d {{(pid=117884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 22 11:21:13.356181 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-f6643b33-d51d-4486-9be4-9b39189714ea tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "DELETE /compute/v2.1/servers/27286438-bce0-447c-9406-2d776cc7c81d/os-volume_attachments/078afddb-d8b8-4334-abc6-dce6b078cb9c" status: 202 len: 0 microversion: 2.1 time: 0.320770 Jul 22 11:21:13.356800 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 398/807] 10.222.0.20 () {58 vars in 1415 bytes} [Fri Jul 22 11:21:13 2022] DELETE /compute/v2.1/servers/27286438-bce0-447c-9406-2d776cc7c81d/os-volume_attachments/078afddb-d8b8-4334-abc6-dce6b078cb9c => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 22 11:21:13.367167 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-19529853-1555-4949-9338-aff8f6c6e77e tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:13.368264 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-19529853-1555-4949-9338-aff8f6c6e77e tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 27286438-bce0-447c-9406-2d776cc7c81d] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:13.377858 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-19529853-1555-4949-9338-aff8f6c6e77e tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:13.378614 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-19529853-1555-4949-9338-aff8f6c6e77e tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:13.380682 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-19529853-1555-4949-9338-aff8f6c6e77e tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:13.382608 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-19529853-1555-4949-9338-aff8f6c6e77e tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:13.414650 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=8,nova_cell1:INSERT=4 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:21:13.434524 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-19529853-1555-4949-9338-aff8f6c6e77e tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/27286438-bce0-447c-9406-2d776cc7c81d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073172 Jul 22 11:21:13.435319 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 410/808] 10.222.0.20 () {58 vars in 1301 bytes} [Fri Jul 22 11:21:13 2022] GET /compute/v2.1/servers/27286438-bce0-447c-9406-2d776cc7c81d/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:21:13.776071 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-af8c28bf-e419-4a19-be07-19c679a6b498 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:13.777222 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-af8c28bf-e419-4a19-be07-19c679a6b498 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:13.787919 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-af8c28bf-e419-4a19-be07-19c679a6b498 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:13.790693 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-af8c28bf-e419-4a19-be07-19c679a6b498 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:13.792427 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-af8c28bf-e419-4a19-be07-19c679a6b498 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:13.793497 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-af8c28bf-e419-4a19-be07-19c679a6b498 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:14.378330 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-af8c28bf-e419-4a19-be07-19c679a6b498 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:14.389959 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-af8c28bf-e419-4a19-be07-19c679a6b498 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:14.395672 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-af8c28bf-e419-4a19-be07-19c679a6b498 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:14.396984 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-af8c28bf-e419-4a19-be07-19c679a6b498 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46" status: 200 len: 1724 microversion: 2.20 time: 0.629321 Jul 22 11:21:14.397871 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 399/809] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:21:13 2022] GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 => generated 1724 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:21:14.448812 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-67f274b2-0a2f-4d01-ad3d-89b1745d0aee tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:14.450707 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-67f274b2-0a2f-4d01-ad3d-89b1745d0aee tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 27286438-bce0-447c-9406-2d776cc7c81d] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:14.458828 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-67f274b2-0a2f-4d01-ad3d-89b1745d0aee tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:14.459653 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-67f274b2-0a2f-4d01-ad3d-89b1745d0aee tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:14.460801 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-67f274b2-0a2f-4d01-ad3d-89b1745d0aee tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:14.461586 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-67f274b2-0a2f-4d01-ad3d-89b1745d0aee tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:14.523840 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-67f274b2-0a2f-4d01-ad3d-89b1745d0aee tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/27286438-bce0-447c-9406-2d776cc7c81d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079137 Jul 22 11:21:14.525017 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 411/810] 10.222.0.20 () {58 vars in 1301 bytes} [Fri Jul 22 11:21:14 2022] GET /compute/v2.1/servers/27286438-bce0-447c-9406-2d776cc7c81d/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:21:15.416169 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-ba608cd8-8d0f-4451-b1ef-4f48226f6a81 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:15.416778 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-ba608cd8-8d0f-4451-b1ef-4f48226f6a81 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:15.423672 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-ba608cd8-8d0f-4451-b1ef-4f48226f6a81 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:15.424893 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-ba608cd8-8d0f-4451-b1ef-4f48226f6a81 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:15.425874 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-ba608cd8-8d0f-4451-b1ef-4f48226f6a81 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:15.426564 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-ba608cd8-8d0f-4451-b1ef-4f48226f6a81 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:15.536102 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-d7e80618-c177-4d8e-a534-387b09015e74 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:15.537044 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-d7e80618-c177-4d8e-a534-387b09015e74 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 27286438-bce0-447c-9406-2d776cc7c81d] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:15.543473 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d7e80618-c177-4d8e-a534-387b09015e74 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:15.543922 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d7e80618-c177-4d8e-a534-387b09015e74 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:15.544699 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d7e80618-c177-4d8e-a534-387b09015e74 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:15.545132 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d7e80618-c177-4d8e-a534-387b09015e74 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:15.610431 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-d7e80618-c177-4d8e-a534-387b09015e74 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/27286438-bce0-447c-9406-2d776cc7c81d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078133 Jul 22 11:21:15.611373 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 412/811] 10.222.0.20 () {58 vars in 1301 bytes} [Fri Jul 22 11:21:15 2022] GET /compute/v2.1/servers/27286438-bce0-447c-9406-2d776cc7c81d/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:21:15.688235 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-ba608cd8-8d0f-4451-b1ef-4f48226f6a81 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:15.709149 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-ba608cd8-8d0f-4451-b1ef-4f48226f6a81 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:15.710765 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-ba608cd8-8d0f-4451-b1ef-4f48226f6a81 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:15.712889 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-ba608cd8-8d0f-4451-b1ef-4f48226f6a81 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46" status: 200 len: 1724 microversion: 2.20 time: 0.300907 Jul 22 11:21:15.713859 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 400/812] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:21:15 2022] GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 => generated 1724 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:21:16.439514 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-d6f27035-1830-42b4-a35c-39f4c269d5a1 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Action: 'create', calling method: .version_select at 0x7f844994c9d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-600883544", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA9P68hAv66d02UPIG/ID4xBxp3xBaWiZP/wJdz5jGu6vhPwln7btmzWgBQ3MpUiF9V3OyffMQJ//LxAnQWZWRWfKInpEdAIrnGbb1nVcIBb5GC2H1lZzjWJdGD3Tht2SQ=="}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:21:16.454435 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-d6f27035-1830-42b4-a35c-39f4c269d5a1 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Getting quotas for project 04d58bceb8414b02a1bbaec0db07d85e. Resources: {'key_pairs'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 22 11:21:16.458353 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-d6f27035-1830-42b4-a35c-39f4c269d5a1 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Getting quotas for user 1a299663b56b411b9fc910ddf47103e5 and project 04d58bceb8414b02a1bbaec0db07d85e. Resources: {'key_pairs'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 22 11:21:16.482066 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-d6f27035-1830-42b4-a35c-39f4c269d5a1 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.226941 Jul 22 11:21:16.482690 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 413/813] 10.222.0.20 () {60 vars in 1158 bytes} [Fri Jul 22 11:21:16 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:21:16.623373 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-cd27fe56-f691-4074-af08-d397519c2e7e tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:16.624808 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-cd27fe56-f691-4074-af08-d397519c2e7e tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 27286438-bce0-447c-9406-2d776cc7c81d] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:16.634735 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-cd27fe56-f691-4074-af08-d397519c2e7e tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:16.635652 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-cd27fe56-f691-4074-af08-d397519c2e7e tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:16.640758 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-cd27fe56-f691-4074-af08-d397519c2e7e tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:16.641520 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-cd27fe56-f691-4074-af08-d397519c2e7e tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:16.681767 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG dbcounter [-] [117884] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:21:16.686616 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-cd27fe56-f691-4074-af08-d397519c2e7e tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/27286438-bce0-447c-9406-2d776cc7c81d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067743 Jul 22 11:21:16.687323 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 401/814] 10.222.0.20 () {58 vars in 1301 bytes} [Fri Jul 22 11:21:16 2022] GET /compute/v2.1/servers/27286438-bce0-447c-9406-2d776cc7c81d/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:21:16.733849 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-71de3870-c001-495f-af0f-652041908d9f tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:16.734465 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-71de3870-c001-495f-af0f-652041908d9f tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:16.741298 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-71de3870-c001-495f-af0f-652041908d9f tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:16.742790 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-71de3870-c001-495f-af0f-652041908d9f tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:16.744128 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-71de3870-c001-495f-af0f-652041908d9f tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:16.744574 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-71de3870-c001-495f-af0f-652041908d9f tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:16.912233 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-71de3870-c001-495f-af0f-652041908d9f tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:16.940751 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-71de3870-c001-495f-af0f-652041908d9f tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:16.945146 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-71de3870-c001-495f-af0f-652041908d9f tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:16.946630 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-71de3870-c001-495f-af0f-652041908d9f tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46" status: 200 len: 1724 microversion: 2.20 time: 0.218112 Jul 22 11:21:16.947436 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 414/815] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:21:16 2022] GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 => generated 1724 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:21:17.698309 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-659373e5-8ec6-4b15-92c3-0e3541fee425 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:17.699302 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-659373e5-8ec6-4b15-92c3-0e3541fee425 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 27286438-bce0-447c-9406-2d776cc7c81d] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:17.708393 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-659373e5-8ec6-4b15-92c3-0e3541fee425 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:17.709144 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-659373e5-8ec6-4b15-92c3-0e3541fee425 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:17.710110 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-659373e5-8ec6-4b15-92c3-0e3541fee425 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:17.710730 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-659373e5-8ec6-4b15-92c3-0e3541fee425 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:17.750762 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-659373e5-8ec6-4b15-92c3-0e3541fee425 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/27286438-bce0-447c-9406-2d776cc7c81d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056324 Jul 22 11:21:17.755033 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 402/816] 10.222.0.20 () {58 vars in 1301 bytes} [Fri Jul 22 11:21:17 2022] GET /compute/v2.1/servers/27286438-bce0-447c-9406-2d776cc7c81d/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:21:17.966181 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-b7e03873-ff6f-404d-829e-0ceae01cf46e tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:17.967744 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-b7e03873-ff6f-404d-829e-0ceae01cf46e tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:17.975355 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b7e03873-ff6f-404d-829e-0ceae01cf46e tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:17.976105 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b7e03873-ff6f-404d-829e-0ceae01cf46e tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:17.977184 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b7e03873-ff6f-404d-829e-0ceae01cf46e tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:17.977853 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b7e03873-ff6f-404d-829e-0ceae01cf46e tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:18.211919 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-b7e03873-ff6f-404d-829e-0ceae01cf46e tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:18.238308 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-b7e03873-ff6f-404d-829e-0ceae01cf46e tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:18.242451 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-b7e03873-ff6f-404d-829e-0ceae01cf46e tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:18.245757 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-b7e03873-ff6f-404d-829e-0ceae01cf46e tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46" status: 200 len: 1745 microversion: 2.20 time: 0.283106 Jul 22 11:21:18.248158 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 415/817] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:21:17 2022] GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 => generated 1745 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 22 11:21:18.763359 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-2f41a33f-0356-4a4a-8d7d-2b6059e9c941 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:18.764269 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-2f41a33f-0356-4a4a-8d7d-2b6059e9c941 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 27286438-bce0-447c-9406-2d776cc7c81d] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:18.771560 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-2f41a33f-0356-4a4a-8d7d-2b6059e9c941 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:18.771799 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-2f41a33f-0356-4a4a-8d7d-2b6059e9c941 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:18.772548 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-2f41a33f-0356-4a4a-8d7d-2b6059e9c941 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:18.773035 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-2f41a33f-0356-4a4a-8d7d-2b6059e9c941 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:18.805774 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-2f41a33f-0356-4a4a-8d7d-2b6059e9c941 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/27286438-bce0-447c-9406-2d776cc7c81d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046989 Jul 22 11:21:18.806365 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 403/818] 10.222.0.20 () {58 vars in 1301 bytes} [Fri Jul 22 11:21:18 2022] GET /compute/v2.1/servers/27286438-bce0-447c-9406-2d776cc7c81d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:21:19.034515 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-3b9abecc-fd92-4750-b645-64d3e8587ea1 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:19.036700 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-3b9abecc-fd92-4750-b645-64d3e8587ea1 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: edc7a08a-180f-4907-9f8d-9d14bd9cf10c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:19.047169 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3b9abecc-fd92-4750-b645-64d3e8587ea1 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:19.049328 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3b9abecc-fd92-4750-b645-64d3e8587ea1 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:19.050949 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3b9abecc-fd92-4750-b645-64d3e8587ea1 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:19.051593 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3b9abecc-fd92-4750-b645-64d3e8587ea1 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:19.118772 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-3b9abecc-fd92-4750-b645-64d3e8587ea1 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/edc7a08a-180f-4907-9f8d-9d14bd9cf10c/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.088617 Jul 22 11:21:19.120213 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 416/819] 10.222.0.20 () {58 vars in 1301 bytes} [Fri Jul 22 11:21:19 2022] GET /compute/v2.1/servers/edc7a08a-180f-4907-9f8d-9d14bd9cf10c/os-volume_attachments => generated 371 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:21:19.275677 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-a080ecee-1135-4340-8ac9-4b28ba5a80a1 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:19.276004 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-2b3d2089-4e25-4fcf-b2ef-97123ffe322d tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:19.278073 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-a080ecee-1135-4340-8ac9-4b28ba5a80a1 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:19.279121 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-2b3d2089-4e25-4fcf-b2ef-97123ffe322d tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: edc7a08a-180f-4907-9f8d-9d14bd9cf10c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:19.290209 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-a080ecee-1135-4340-8ac9-4b28ba5a80a1 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:19.291002 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-a080ecee-1135-4340-8ac9-4b28ba5a80a1 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:19.292435 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-a080ecee-1135-4340-8ac9-4b28ba5a80a1 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:19.294207 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-a080ecee-1135-4340-8ac9-4b28ba5a80a1 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:19.294965 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2b3d2089-4e25-4fcf-b2ef-97123ffe322d tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:19.294965 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2b3d2089-4e25-4fcf-b2ef-97123ffe322d tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:19.296431 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2b3d2089-4e25-4fcf-b2ef-97123ffe322d tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:19.296879 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2b3d2089-4e25-4fcf-b2ef-97123ffe322d tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:19.384220 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-2b3d2089-4e25-4fcf-b2ef-97123ffe322d tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/edc7a08a-180f-4907-9f8d-9d14bd9cf10c/os-volume_attachments/d17a11c3-b806-45ce-b169-f9ba29bef044" status: 200 len: 194 microversion: 2.1 time: 0.110497 Jul 22 11:21:19.393012 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 417/820] 10.222.0.20 () {58 vars in 1412 bytes} [Fri Jul 22 11:21:19 2022] GET /compute/v2.1/servers/edc7a08a-180f-4907-9f8d-9d14bd9cf10c/os-volume_attachments/d17a11c3-b806-45ce-b169-f9ba29bef044 => generated 194 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:21:19.409710 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-1af3c19b-0959-412e-8a79-6081a699ec7f tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:19.411008 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-1af3c19b-0959-412e-8a79-6081a699ec7f tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: edc7a08a-180f-4907-9f8d-9d14bd9cf10c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:19.440682 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1af3c19b-0959-412e-8a79-6081a699ec7f tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:19.441636 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1af3c19b-0959-412e-8a79-6081a699ec7f tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:19.443957 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1af3c19b-0959-412e-8a79-6081a699ec7f tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:19.444808 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1af3c19b-0959-412e-8a79-6081a699ec7f tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:19.554417 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-a080ecee-1135-4340-8ac9-4b28ba5a80a1 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:19.588249 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-a080ecee-1135-4340-8ac9-4b28ba5a80a1 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:19.605246 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-a080ecee-1135-4340-8ac9-4b28ba5a80a1 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:19.606611 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-a080ecee-1135-4340-8ac9-4b28ba5a80a1 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46" status: 200 len: 1745 microversion: 2.20 time: 0.343298 Jul 22 11:21:19.621306 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 404/821] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:21:19 2022] GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 => generated 1745 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:21:19.623113 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.objects.instance [None req-1af3c19b-0959-412e-8a79-6081a699ec7f tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lazy-loading 'services' on Instance uuid edc7a08a-180f-4907-9f8d-9d14bd9cf10c {{(pid=117885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 22 11:21:19.722041 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-1af3c19b-0959-412e-8a79-6081a699ec7f tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "DELETE /compute/v2.1/servers/edc7a08a-180f-4907-9f8d-9d14bd9cf10c/os-volume_attachments/d17a11c3-b806-45ce-b169-f9ba29bef044" status: 202 len: 0 microversion: 2.1 time: 0.326255 Jul 22 11:21:19.728801 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 418/822] 10.222.0.20 () {58 vars in 1415 bytes} [Fri Jul 22 11:21:19 2022] DELETE /compute/v2.1/servers/edc7a08a-180f-4907-9f8d-9d14bd9cf10c/os-volume_attachments/d17a11c3-b806-45ce-b169-f9ba29bef044 => generated 0 bytes in 335 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 22 11:21:19.823041 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-5406a942-c599-4cfb-992f-a879c11b6ee8 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:19.825421 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-5406a942-c599-4cfb-992f-a879c11b6ee8 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 27286438-bce0-447c-9406-2d776cc7c81d] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:19.835839 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-5406a942-c599-4cfb-992f-a879c11b6ee8 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:19.836539 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-5406a942-c599-4cfb-992f-a879c11b6ee8 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:19.837777 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-5406a942-c599-4cfb-992f-a879c11b6ee8 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:19.838458 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-5406a942-c599-4cfb-992f-a879c11b6ee8 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:19.892797 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-5406a942-c599-4cfb-992f-a879c11b6ee8 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/27286438-bce0-447c-9406-2d776cc7c81d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.076664 Jul 22 11:21:19.893402 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 405/823] 10.222.0.20 () {58 vars in 1301 bytes} [Fri Jul 22 11:21:19 2022] GET /compute/v2.1/servers/27286438-bce0-447c-9406-2d776cc7c81d/os-volume_attachments => generated 25 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 22 11:21:19.958495 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-7ed81831-a0a8-490e-a83c-538cbcc5166e tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:19.959072 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-7ed81831-a0a8-490e-a83c-538cbcc5166e tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 27286438-bce0-447c-9406-2d776cc7c81d] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:19.965872 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7ed81831-a0a8-490e-a83c-538cbcc5166e tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:19.966317 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7ed81831-a0a8-490e-a83c-538cbcc5166e tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:19.967092 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7ed81831-a0a8-490e-a83c-538cbcc5166e tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:19.967660 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7ed81831-a0a8-490e-a83c-538cbcc5166e tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:20.014723 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-7ed81831-a0a8-490e-a83c-538cbcc5166e tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 27286438-bce0-447c-9406-2d776cc7c81d] Going to try to terminate instance {{(pid=117885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 22 11:21:20.117369 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-7ed81831-a0a8-490e-a83c-538cbcc5166e tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "DELETE /compute/v2.1/servers/27286438-bce0-447c-9406-2d776cc7c81d" status: 204 len: 0 microversion: 2.1 time: 0.162460 Jul 22 11:21:20.122330 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 419/824] 10.222.0.20 () {58 vars in 1238 bytes} [Fri Jul 22 11:21:19 2022] DELETE /compute/v2.1/servers/27286438-bce0-447c-9406-2d776cc7c81d => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 22 11:21:20.130385 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-4c6c8b83-b886-466d-b3d7-2da8c29de882 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:20.132122 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-4c6c8b83-b886-466d-b3d7-2da8c29de882 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 27286438-bce0-447c-9406-2d776cc7c81d] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:20.142131 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-4c6c8b83-b886-466d-b3d7-2da8c29de882 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:20.142838 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-4c6c8b83-b886-466d-b3d7-2da8c29de882 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:20.144232 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-4c6c8b83-b886-466d-b3d7-2da8c29de882 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:20.144828 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-4c6c8b83-b886-466d-b3d7-2da8c29de882 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:20.192407 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-f73d1b0f-a12f-456b-8ae8-f4d888baa2b0 req-c678a865-73b4-4c4b-85c5-f3086f4270f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46", "name": "network-vif-plugged", "status": "completed", "tag": "c1ac6e13-743e-4cd7-b970-2f05998ba958"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:21:20.201173 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-f73d1b0f-a12f-456b-8ae8-f4d888baa2b0 req-c678a865-73b4-4c4b-85c5-f3086f4270f8 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:20.201977 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-f73d1b0f-a12f-456b-8ae8-f4d888baa2b0 req-c678a865-73b4-4c4b-85c5-f3086f4270f8 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:20.227923 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-f73d1b0f-a12f-456b-8ae8-f4d888baa2b0 req-c678a865-73b4-4c4b-85c5-f3086f4270f8 service nova] Creating event network-vif-plugged:c1ac6e13-743e-4cd7-b970-2f05998ba958 for instance f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 on hv-cinder-84890 Jul 22 11:21:20.241776 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-f73d1b0f-a12f-456b-8ae8-f4d888baa2b0 req-c678a865-73b4-4c4b-85c5-f3086f4270f8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052972 Jul 22 11:21:20.243549 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 420/825] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:21:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 22 11:21:20.373248 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-4c6c8b83-b886-466d-b3d7-2da8c29de882 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:20.385198 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-4c6c8b83-b886-466d-b3d7-2da8c29de882 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/27286438-bce0-447c-9406-2d776cc7c81d" status: 200 len: 1681 microversion: 2.1 time: 0.261739 Jul 22 11:21:20.395353 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 406/826] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:21:20 2022] GET /compute/v2.1/servers/27286438-bce0-447c-9406-2d776cc7c81d => generated 1681 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:21:20.629730 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-d38ef2ee-2689-430b-a5c4-720abc828af4 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:20.630802 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-d38ef2ee-2689-430b-a5c4-720abc828af4 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:20.637087 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d38ef2ee-2689-430b-a5c4-720abc828af4 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:20.637705 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d38ef2ee-2689-430b-a5c4-720abc828af4 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:20.638296 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d38ef2ee-2689-430b-a5c4-720abc828af4 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:20.638726 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d38ef2ee-2689-430b-a5c4-720abc828af4 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:20.893881 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-d38ef2ee-2689-430b-a5c4-720abc828af4 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:20.914501 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-d38ef2ee-2689-430b-a5c4-720abc828af4 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:20.931733 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-d38ef2ee-2689-430b-a5c4-720abc828af4 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:20.934107 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-d38ef2ee-2689-430b-a5c4-720abc828af4 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46" status: 200 len: 1745 microversion: 2.20 time: 0.309334 Jul 22 11:21:20.951987 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 421/827] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:21:20 2022] GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 => generated 1745 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:21:21.404223 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-c45ac065-74ee-485c-b8d9-a241d74152c2 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:21.404897 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-c45ac065-74ee-485c-b8d9-a241d74152c2 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 27286438-bce0-447c-9406-2d776cc7c81d] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:21.414597 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c45ac065-74ee-485c-b8d9-a241d74152c2 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:21.415137 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c45ac065-74ee-485c-b8d9-a241d74152c2 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:21.415860 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c45ac065-74ee-485c-b8d9-a241d74152c2 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:21.416292 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c45ac065-74ee-485c-b8d9-a241d74152c2 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:21.592492 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-c45ac065-74ee-485c-b8d9-a241d74152c2 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:21.606156 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-c45ac065-74ee-485c-b8d9-a241d74152c2 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/27286438-bce0-447c-9406-2d776cc7c81d" status: 200 len: 1681 microversion: 2.1 time: 0.205703 Jul 22 11:21:21.606748 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 407/828] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:21:21 2022] GET /compute/v2.1/servers/27286438-bce0-447c-9406-2d776cc7c81d => generated 1681 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:21:21.964016 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-c01d680b-1307-4dfd-b5f1-57682ced57bf tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:21.965377 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-c01d680b-1307-4dfd-b5f1-57682ced57bf tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:21.976057 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c01d680b-1307-4dfd-b5f1-57682ced57bf tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:21.976849 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c01d680b-1307-4dfd-b5f1-57682ced57bf tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:21.979303 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c01d680b-1307-4dfd-b5f1-57682ced57bf tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:21.980169 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c01d680b-1307-4dfd-b5f1-57682ced57bf tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:22.184979 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-c01d680b-1307-4dfd-b5f1-57682ced57bf tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:22.193188 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-c01d680b-1307-4dfd-b5f1-57682ced57bf tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:22.194676 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-c01d680b-1307-4dfd-b5f1-57682ced57bf tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:22.195872 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-c01d680b-1307-4dfd-b5f1-57682ced57bf tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46" status: 200 len: 1740 microversion: 2.20 time: 0.238416 Jul 22 11:21:22.196433 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 422/829] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:21:21 2022] GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 => generated 1740 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:21:22.626515 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-f8dc5351-215f-4f93-ab4a-598b1b837624 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:22.628658 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-f8dc5351-215f-4f93-ab4a-598b1b837624 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 27286438-bce0-447c-9406-2d776cc7c81d] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:22.640337 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG dbcounter [-] [117884] Writing DB stats nova_api:SELECT=47 {{(pid=117884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:21:22.642510 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f8dc5351-215f-4f93-ab4a-598b1b837624 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:22.645796 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f8dc5351-215f-4f93-ab4a-598b1b837624 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:22.647810 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f8dc5351-215f-4f93-ab4a-598b1b837624 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:22.648985 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f8dc5351-215f-4f93-ab4a-598b1b837624 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:22.921512 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-f8dc5351-215f-4f93-ab4a-598b1b837624 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:22.938254 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-f8dc5351-215f-4f93-ab4a-598b1b837624 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/27286438-bce0-447c-9406-2d776cc7c81d" status: 200 len: 1681 microversion: 2.1 time: 0.315791 Jul 22 11:21:22.940426 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 408/830] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:21:22 2022] GET /compute/v2.1/servers/27286438-bce0-447c-9406-2d776cc7c81d => generated 1681 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:21:23.128979 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-261accfe-bea0-45a1-9bdf-009cd52df03f tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:23.129687 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-261accfe-bea0-45a1-9bdf-009cd52df03f tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: edc7a08a-180f-4907-9f8d-9d14bd9cf10c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:23.133965 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:21:23.153578 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-261accfe-bea0-45a1-9bdf-009cd52df03f tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:23.154143 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-261accfe-bea0-45a1-9bdf-009cd52df03f tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:23.160333 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-261accfe-bea0-45a1-9bdf-009cd52df03f tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:23.161068 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-261accfe-bea0-45a1-9bdf-009cd52df03f tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:23.205355 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-261accfe-bea0-45a1-9bdf-009cd52df03f tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/edc7a08a-180f-4907-9f8d-9d14bd9cf10c/os-volume_attachments/a2601b22-4e10-4313-8c99-ed90248d4871" status: 200 len: 194 microversion: 2.1 time: 0.097493 Jul 22 11:21:23.206998 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 423/831] 10.222.0.20 () {58 vars in 1412 bytes} [Fri Jul 22 11:21:23 2022] GET /compute/v2.1/servers/edc7a08a-180f-4907-9f8d-9d14bd9cf10c/os-volume_attachments/a2601b22-4e10-4313-8c99-ed90248d4871 => generated 194 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:21:23.219754 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-fb13a119-20aa-4d0a-9845-a6e61f0671da tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:23.220673 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-fb13a119-20aa-4d0a-9845-a6e61f0671da tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: edc7a08a-180f-4907-9f8d-9d14bd9cf10c] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:23.225161 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-05e469a5-e980-4f6d-9a9b-375f627259f7 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:23.225822 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-05e469a5-e980-4f6d-9a9b-375f627259f7 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:23.232552 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-fb13a119-20aa-4d0a-9845-a6e61f0671da tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:23.233266 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-fb13a119-20aa-4d0a-9845-a6e61f0671da tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:23.233418 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-05e469a5-e980-4f6d-9a9b-375f627259f7 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:23.233870 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-05e469a5-e980-4f6d-9a9b-375f627259f7 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:23.234668 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-fb13a119-20aa-4d0a-9845-a6e61f0671da tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:23.234791 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-05e469a5-e980-4f6d-9a9b-375f627259f7 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:23.235223 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-05e469a5-e980-4f6d-9a9b-375f627259f7 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:23.235748 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-fb13a119-20aa-4d0a-9845-a6e61f0671da tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:23.406990 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.objects.instance [None req-fb13a119-20aa-4d0a-9845-a6e61f0671da tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lazy-loading 'services' on Instance uuid edc7a08a-180f-4907-9f8d-9d14bd9cf10c {{(pid=117884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 22 11:21:23.479007 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-05e469a5-e980-4f6d-9a9b-375f627259f7 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:23.501590 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-05e469a5-e980-4f6d-9a9b-375f627259f7 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:23.507649 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-05e469a5-e980-4f6d-9a9b-375f627259f7 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:23.510815 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-05e469a5-e980-4f6d-9a9b-375f627259f7 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46" status: 200 len: 1740 microversion: 2.20 time: 0.288989 Jul 22 11:21:23.519308 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 424/832] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:21:23 2022] GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 => generated 1740 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 22 11:21:23.555841 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-fb13a119-20aa-4d0a-9845-a6e61f0671da tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "DELETE /compute/v2.1/servers/edc7a08a-180f-4907-9f8d-9d14bd9cf10c/os-volume_attachments/a2601b22-4e10-4313-8c99-ed90248d4871" status: 202 len: 0 microversion: 2.1 time: 0.342396 Jul 22 11:21:23.560575 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 409/833] 10.222.0.20 () {58 vars in 1415 bytes} [Fri Jul 22 11:21:23 2022] DELETE /compute/v2.1/servers/edc7a08a-180f-4907-9f8d-9d14bd9cf10c/os-volume_attachments/a2601b22-4e10-4313-8c99-ed90248d4871 => generated 0 bytes in 348 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 22 11:21:23.956941 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-d392f430-0aa3-4791-a8cf-06d14c44d66f tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:23.957562 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-d392f430-0aa3-4791-a8cf-06d14c44d66f tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 27286438-bce0-447c-9406-2d776cc7c81d] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:23.975801 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d392f430-0aa3-4791-a8cf-06d14c44d66f tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:23.976254 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d392f430-0aa3-4791-a8cf-06d14c44d66f tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:23.977050 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d392f430-0aa3-4791-a8cf-06d14c44d66f tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:23.977488 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d392f430-0aa3-4791-a8cf-06d14c44d66f tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:24.008559 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [req-be32a81f-63f4-4963-864a-aba2c544bfb6 req-02e124d5-42bf-46c1-bfcc-ddf4d3ff2e5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27286438-bce0-447c-9406-2d776cc7c81d", "name": "network-vif-deleted", "tag": "af37cf80-6a03-4866-87c0-372fd391424e"}]} {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:21:24.025797 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-be32a81f-63f4-4963-864a-aba2c544bfb6 req-02e124d5-42bf-46c1-bfcc-ddf4d3ff2e5f service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:24.026241 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-be32a81f-63f4-4963-864a-aba2c544bfb6 req-02e124d5-42bf-46c1-bfcc-ddf4d3ff2e5f service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:24.067298 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.compute.server_external_events [req-be32a81f-63f4-4963-864a-aba2c544bfb6 req-02e124d5-42bf-46c1-bfcc-ddf4d3ff2e5f service nova] Creating event network-vif-deleted:af37cf80-6a03-4866-87c0-372fd391424e for instance 27286438-bce0-447c-9406-2d776cc7c81d on hv-cinder-84890 Jul 22 11:21:24.075551 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [req-be32a81f-63f4-4963-864a-aba2c544bfb6 req-02e124d5-42bf-46c1-bfcc-ddf4d3ff2e5f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070964 Jul 22 11:21:24.105133 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 410/834] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:21:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:21:24.165794 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-d392f430-0aa3-4791-a8cf-06d14c44d66f tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691877dce1024aeda61629073d74602b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28836b7cb9c646aaaa1bb1c1fae68128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:24.175542 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-d392f430-0aa3-4791-a8cf-06d14c44d66f tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/27286438-bce0-447c-9406-2d776cc7c81d" status: 200 len: 1614 microversion: 2.1 time: 0.222453 Jul 22 11:21:24.192157 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 425/835] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:21:23 2022] GET /compute/v2.1/servers/27286438-bce0-447c-9406-2d776cc7c81d => generated 1614 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:21:24.533033 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-5452409e-1e4c-42f9-96e6-0e8c72b02e46 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:24.534220 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-5452409e-1e4c-42f9-96e6-0e8c72b02e46 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:24.545571 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-5452409e-1e4c-42f9-96e6-0e8c72b02e46 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:24.547153 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-5452409e-1e4c-42f9-96e6-0e8c72b02e46 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:24.548579 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-5452409e-1e4c-42f9-96e6-0e8c72b02e46 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:24.549763 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-5452409e-1e4c-42f9-96e6-0e8c72b02e46 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:24.952123 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-5452409e-1e4c-42f9-96e6-0e8c72b02e46 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:24.968800 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-1e08f2e0-8c38-442d-9be2-e45196e21824 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:24.969098 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-5452409e-1e4c-42f9-96e6-0e8c72b02e46 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:24.971233 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-1e08f2e0-8c38-442d-9be2-e45196e21824 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: edc7a08a-180f-4907-9f8d-9d14bd9cf10c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:24.971747 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-5452409e-1e4c-42f9-96e6-0e8c72b02e46 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:24.984468 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-5452409e-1e4c-42f9-96e6-0e8c72b02e46 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46" status: 200 len: 1740 microversion: 2.20 time: 0.444510 Jul 22 11:21:24.985392 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 411/836] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:21:24 2022] GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 => generated 1740 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 22 11:21:24.999648 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1e08f2e0-8c38-442d-9be2-e45196e21824 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:25.001984 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1e08f2e0-8c38-442d-9be2-e45196e21824 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:25.003407 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1e08f2e0-8c38-442d-9be2-e45196e21824 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:25.004137 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1e08f2e0-8c38-442d-9be2-e45196e21824 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:25.087308 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:21:25.127833 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-1e08f2e0-8c38-442d-9be2-e45196e21824 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/edc7a08a-180f-4907-9f8d-9d14bd9cf10c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.164371 Jul 22 11:21:25.129010 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 426/837] 10.222.0.20 () {58 vars in 1301 bytes} [Fri Jul 22 11:21:24 2022] GET /compute/v2.1/servers/edc7a08a-180f-4907-9f8d-9d14bd9cf10c/os-volume_attachments => generated 25 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 22 11:21:25.206619 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-e8df9496-c642-4402-ac90-7a9a634d1683 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:25.207347 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-e8df9496-c642-4402-ac90-7a9a634d1683 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 27286438-bce0-447c-9406-2d776cc7c81d] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:25.243017 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-e8df9496-c642-4402-ac90-7a9a634d1683 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:25.252876 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-e8df9496-c642-4402-ac90-7a9a634d1683 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:25.253947 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-e8df9496-c642-4402-ac90-7a9a634d1683 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:25.254491 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-e8df9496-c642-4402-ac90-7a9a634d1683 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:25.280314 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.wsgi [None req-e8df9496-c642-4402-ac90-7a9a634d1683 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] HTTP exception thrown: Instance 27286438-bce0-447c-9406-2d776cc7c81d could not be found. Jul 22 11:21:25.283975 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-e8df9496-c642-4402-ac90-7a9a634d1683 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Request method failure captured: Jul 22 11:21:25.283975 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: request: GET /compute/v2.1/servers/27286438-bce0-447c-9406-2d776cc7c81d HTTP/1.1 Jul 22 11:21:25.283975 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Accept: application/json Jul 22 11:21:25.283975 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Accept-Encoding: identity Jul 22 11:21:25.283975 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Connection: close Jul 22 11:21:25.283975 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Content-Length: 0 Jul 22 11:21:25.283975 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Content-Type: application/json Jul 22 11:21:25.283975 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Host: 10.222.0.20 Jul 22 11:21:25.283975 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Openstack-System-Scope: None Jul 22 11:21:25.283975 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: User-Agent: python-urllib3/1.26.9 Jul 22 11:21:25.283975 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Auth-Token: gAAAAABi2oZ52By6vC80uVvQ5nsWGLE19ZXI57S3ld1fjPibH8fuUYjCV8gJDPh42GzMe4RKMojTgGaj2CCjG1yohpK4Rm5k-mOJAFOmJU-P2lN4F8UiP8lUppBYVH0uVfdef6vJD72z_c72VmeWRwsVQhXxsOTWQe5Gh1G1aCThgwUg9CYgRRw Jul 22 11:21:25.283975 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Domain-Id: None Jul 22 11:21:25.283975 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Domain-Name: None Jul 22 11:21:25.283975 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Identity-Status: Confirmed Jul 22 11:21:25.283975 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Is-Admin-Project: True Jul 22 11:21:25.283975 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Domain-Id: default Jul 22 11:21:25.283975 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Domain-Name: Default Jul 22 11:21:25.283975 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Id: 28836b7cb9c646aaaa1bb1c1fae68128 Jul 22 11:21:25.283975 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Name: tempest-AttachVolumeNegativeTest-1017563372 Jul 22 11:21:25.283975 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Role: reader,member Jul 22 11:21:25.283975 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Roles: reader,member Jul 22 11:21:25.285498 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/28836b7cb9c646aaaa1bb1c1fae68128"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_28836b7cb9c646aaaa1bb1c1fae68128", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/28836b7cb9c646aaaa1bb1c1fae68128"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/28836b7cb9c646aaaa1bb1c1fae68128"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jul 22 11:21:25.285498 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant: tempest-AttachVolumeNegativeTest-1017563372 Jul 22 11:21:25.285498 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant-Id: 28836b7cb9c646aaaa1bb1c1fae68128 Jul 22 11:21:25.285498 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1017563372 Jul 22 11:21:25.285498 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User: tempest-AttachVolumeNegativeTest-1017563372-project Jul 22 11:21:25.285498 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Domain-Id: default Jul 22 11:21:25.285498 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Domain-Name: Default Jul 22 11:21:25.285498 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Id: 691877dce1024aeda61629073d74602b Jul 22 11:21:25.285498 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Name: tempest-AttachVolumeNegativeTest-1017563372-project Jul 22 11:21:25.285498 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: method: > Jul 22 11:21:25.285498 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: exception: Instance 27286438-bce0-447c-9406-2d776cc7c81d could not be found. Jul 22 11:21:25.285498 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: action_args: {'id': '27286438-bce0-447c-9406-2d776cc7c81d'} Jul 22 11:21:25.286401 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 22 11:21:25.286401 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:21:25.286401 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 22 11:21:25.286401 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 22 11:21:25.286401 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 22 11:21:25.286401 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 22 11:21:25.286401 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 22 11:21:25.286401 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 22 11:21:25.286401 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 22 11:21:25.286401 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 22 11:21:25.286401 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27286438-bce0-447c-9406-2d776cc7c81d could not be found. Jul 22 11:21:25.286401 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:21:25.286401 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:21:25.286401 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:21:25.286401 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:21:25.286401 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:21:25.286401 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:21:25.286401 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 22 11:21:25.286401 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 22 11:21:25.286401 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 22 11:21:25.287790 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 22 11:21:25.287790 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 22 11:21:25.287790 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 22 11:21:25.287790 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 22 11:21:25.287790 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 22 11:21:25.287790 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 22 11:21:25.287790 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 22 11:21:25.287790 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27286438-bce0-447c-9406-2d776cc7c81d could not be found. Jul 22 11:21:25.287790 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:21:25.287790 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:21:25.287790 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:21:25.287790 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:21:25.287790 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:21:25.287790 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:21:25.287790 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 22 11:21:25.287790 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 22 11:21:25.287790 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27286438-bce0-447c-9406-2d776cc7c81d could not be found. Jul 22 11:21:25.287790 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:21:25.291131 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-e8df9496-c642-4402-ac90-7a9a634d1683 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Returning 404 to user: Instance 27286438-bce0-447c-9406-2d776cc7c81d could not be found. {{(pid=117884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 22 11:21:25.292722 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-e8df9496-c642-4402-ac90-7a9a634d1683 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/27286438-bce0-447c-9406-2d776cc7c81d" status: 404 len: 111 microversion: 2.1 time: 0.091795 Jul 22 11:21:25.294568 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 412/838] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:21:25 2022] GET /compute/v2.1/servers/27286438-bce0-447c-9406-2d776cc7c81d => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 22 11:21:25.311658 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-9ef660cc-91b2-44ca-867a-f7547676e193 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '.version_select at 0x7f8445156940>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:25.318101 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-7596bd09-13f9-4f69-b092-15c01ef205c1 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:25.319433 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-7596bd09-13f9-4f69-b092-15c01ef205c1 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: edc7a08a-180f-4907-9f8d-9d14bd9cf10c] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:25.327674 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-7596bd09-13f9-4f69-b092-15c01ef205c1 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:25.328116 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-7596bd09-13f9-4f69-b092-15c01ef205c1 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:25.329188 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-7596bd09-13f9-4f69-b092-15c01ef205c1 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:25.329777 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-7596bd09-13f9-4f69-b092-15c01ef205c1 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:25.350944 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-9ef660cc-91b2-44ca-867a-f7547676e193 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1420537121" status: 202 len: 0 microversion: 2.1 time: 0.050789 Jul 22 11:21:25.367766 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 427/839] 10.222.0.20 () {58 vars in 1220 bytes} [Fri Jul 22 11:21:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1420537121 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 22 11:21:25.398155 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-7596bd09-13f9-4f69-b092-15c01ef205c1 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/edc7a08a-180f-4907-9f8d-9d14bd9cf10c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.085211 Jul 22 11:21:25.399438 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 413/840] 10.222.0.20 () {58 vars in 1301 bytes} [Fri Jul 22 11:21:25 2022] GET /compute/v2.1/servers/edc7a08a-180f-4907-9f8d-9d14bd9cf10c/os-volume_attachments => generated 25 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 22 11:21:25.497462 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-affa72fe-5b15-48a5-af73-6bc7522560e1 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:25.498295 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-affa72fe-5b15-48a5-af73-6bc7522560e1 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: edc7a08a-180f-4907-9f8d-9d14bd9cf10c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:25.506789 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-affa72fe-5b15-48a5-af73-6bc7522560e1 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:25.507884 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-affa72fe-5b15-48a5-af73-6bc7522560e1 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:25.508932 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-affa72fe-5b15-48a5-af73-6bc7522560e1 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:25.509684 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-affa72fe-5b15-48a5-af73-6bc7522560e1 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:25.556010 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-affa72fe-5b15-48a5-af73-6bc7522560e1 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: edc7a08a-180f-4907-9f8d-9d14bd9cf10c] Going to try to terminate instance {{(pid=117885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 22 11:21:25.736733 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-affa72fe-5b15-48a5-af73-6bc7522560e1 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "DELETE /compute/v2.1/servers/edc7a08a-180f-4907-9f8d-9d14bd9cf10c" status: 204 len: 0 microversion: 2.1 time: 0.242941 Jul 22 11:21:25.738357 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 428/841] 10.222.0.20 () {58 vars in 1238 bytes} [Fri Jul 22 11:21:25 2022] DELETE /compute/v2.1/servers/edc7a08a-180f-4907-9f8d-9d14bd9cf10c => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 22 11:21:25.752960 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-7fbe113a-2559-4f79-a784-f1792c50d926 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:25.753923 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-7fbe113a-2559-4f79-a784-f1792c50d926 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: edc7a08a-180f-4907-9f8d-9d14bd9cf10c] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:25.762916 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-7fbe113a-2559-4f79-a784-f1792c50d926 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:25.764229 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-7fbe113a-2559-4f79-a784-f1792c50d926 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:25.765899 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-7fbe113a-2559-4f79-a784-f1792c50d926 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:25.766882 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-7fbe113a-2559-4f79-a784-f1792c50d926 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:25.978031 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-7fbe113a-2559-4f79-a784-f1792c50d926 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:26.002963 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-7fbe113a-2559-4f79-a784-f1792c50d926 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/edc7a08a-180f-4907-9f8d-9d14bd9cf10c" status: 200 len: 1673 microversion: 2.1 time: 0.258204 Jul 22 11:21:26.009998 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-2c257bf9-5326-4f82-b480-68e94e9ca99c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:26.010977 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-2c257bf9-5326-4f82-b480-68e94e9ca99c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:26.018570 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 414/842] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:21:25 2022] GET /compute/v2.1/servers/edc7a08a-180f-4907-9f8d-9d14bd9cf10c => generated 1673 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:21:26.024204 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2c257bf9-5326-4f82-b480-68e94e9ca99c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:26.025534 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2c257bf9-5326-4f82-b480-68e94e9ca99c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:26.026746 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2c257bf9-5326-4f82-b480-68e94e9ca99c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:26.027671 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2c257bf9-5326-4f82-b480-68e94e9ca99c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:26.465130 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-2c257bf9-5326-4f82-b480-68e94e9ca99c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:26.474159 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell0:SELECT=4 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:21:26.478634 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-2c257bf9-5326-4f82-b480-68e94e9ca99c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:26.480517 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-2c257bf9-5326-4f82-b480-68e94e9ca99c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:26.481749 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-2c257bf9-5326-4f82-b480-68e94e9ca99c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46" status: 200 len: 1740 microversion: 2.20 time: 0.476471 Jul 22 11:21:26.482321 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 429/843] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:21:26 2022] GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 => generated 1740 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:21:27.046120 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-3b28c4b5-2f9b-40a1-bcd7-b651f64e847b tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:27.046970 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-3b28c4b5-2f9b-40a1-bcd7-b651f64e847b tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: edc7a08a-180f-4907-9f8d-9d14bd9cf10c] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:27.063273 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-3b28c4b5-2f9b-40a1-bcd7-b651f64e847b tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:27.063884 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-3b28c4b5-2f9b-40a1-bcd7-b651f64e847b tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:27.065000 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-3b28c4b5-2f9b-40a1-bcd7-b651f64e847b tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:27.065477 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-3b28c4b5-2f9b-40a1-bcd7-b651f64e847b tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:27.273605 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-3b28c4b5-2f9b-40a1-bcd7-b651f64e847b tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:27.280204 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-3b28c4b5-2f9b-40a1-bcd7-b651f64e847b tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/edc7a08a-180f-4907-9f8d-9d14bd9cf10c" status: 200 len: 1673 microversion: 2.1 time: 0.239766 Jul 22 11:21:27.281165 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 415/844] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:21:27 2022] GET /compute/v2.1/servers/edc7a08a-180f-4907-9f8d-9d14bd9cf10c => generated 1673 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:21:27.505289 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-2cd5227c-25da-4ee1-9475-b8297fbb12d1 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:27.506570 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-2cd5227c-25da-4ee1-9475-b8297fbb12d1 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:27.519712 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2cd5227c-25da-4ee1-9475-b8297fbb12d1 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:27.520728 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2cd5227c-25da-4ee1-9475-b8297fbb12d1 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:27.523741 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2cd5227c-25da-4ee1-9475-b8297fbb12d1 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:27.527228 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2cd5227c-25da-4ee1-9475-b8297fbb12d1 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:27.765885 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-2cd5227c-25da-4ee1-9475-b8297fbb12d1 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:27.803480 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-2cd5227c-25da-4ee1-9475-b8297fbb12d1 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:27.806872 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-2cd5227c-25da-4ee1-9475-b8297fbb12d1 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:27.809211 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-2cd5227c-25da-4ee1-9475-b8297fbb12d1 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46" status: 200 len: 1740 microversion: 2.20 time: 0.309474 Jul 22 11:21:27.822897 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-cb3705f0-dae6-450f-bef4-ef342439c421 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:27.823712 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-cb3705f0-dae6-450f-bef4-ef342439c421 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 27286438-bce0-447c-9406-2d776cc7c81d] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:27.829412 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 430/845] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:21:27 2022] GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 => generated 1740 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:21:27.832360 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-cb3705f0-dae6-450f-bef4-ef342439c421 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:27.833050 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-cb3705f0-dae6-450f-bef4-ef342439c421 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:27.834019 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-cb3705f0-dae6-450f-bef4-ef342439c421 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:27.834454 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-cb3705f0-dae6-450f-bef4-ef342439c421 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:27.853079 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.wsgi [None req-cb3705f0-dae6-450f-bef4-ef342439c421 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] HTTP exception thrown: Instance 27286438-bce0-447c-9406-2d776cc7c81d could not be found. Jul 22 11:21:27.855667 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-cb3705f0-dae6-450f-bef4-ef342439c421 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Request method failure captured: Jul 22 11:21:27.855667 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: request: DELETE /compute/v2.1/servers/27286438-bce0-447c-9406-2d776cc7c81d HTTP/1.1 Jul 22 11:21:27.855667 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Accept: application/json Jul 22 11:21:27.855667 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Accept-Encoding: identity Jul 22 11:21:27.855667 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Connection: close Jul 22 11:21:27.855667 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Content-Length: 0 Jul 22 11:21:27.855667 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Content-Type: application/json Jul 22 11:21:27.855667 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Host: 10.222.0.20 Jul 22 11:21:27.855667 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Openstack-System-Scope: None Jul 22 11:21:27.855667 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: User-Agent: python-urllib3/1.26.9 Jul 22 11:21:27.855667 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Auth-Token: gAAAAABi2oZ52By6vC80uVvQ5nsWGLE19ZXI57S3ld1fjPibH8fuUYjCV8gJDPh42GzMe4RKMojTgGaj2CCjG1yohpK4Rm5k-mOJAFOmJU-P2lN4F8UiP8lUppBYVH0uVfdef6vJD72z_c72VmeWRwsVQhXxsOTWQe5Gh1G1aCThgwUg9CYgRRw Jul 22 11:21:27.855667 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Domain-Id: None Jul 22 11:21:27.855667 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Domain-Name: None Jul 22 11:21:27.855667 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Identity-Status: Confirmed Jul 22 11:21:27.855667 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Is-Admin-Project: True Jul 22 11:21:27.855667 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Domain-Id: default Jul 22 11:21:27.855667 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Domain-Name: Default Jul 22 11:21:27.855667 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Id: 28836b7cb9c646aaaa1bb1c1fae68128 Jul 22 11:21:27.855667 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Name: tempest-AttachVolumeNegativeTest-1017563372 Jul 22 11:21:27.855667 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Role: reader,member Jul 22 11:21:27.855667 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Roles: reader,member Jul 22 11:21:27.859931 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/28836b7cb9c646aaaa1bb1c1fae68128"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_28836b7cb9c646aaaa1bb1c1fae68128", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/28836b7cb9c646aaaa1bb1c1fae68128"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/28836b7cb9c646aaaa1bb1c1fae68128"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jul 22 11:21:27.859931 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant: tempest-AttachVolumeNegativeTest-1017563372 Jul 22 11:21:27.859931 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant-Id: 28836b7cb9c646aaaa1bb1c1fae68128 Jul 22 11:21:27.859931 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1017563372 Jul 22 11:21:27.859931 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User: tempest-AttachVolumeNegativeTest-1017563372-project Jul 22 11:21:27.859931 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Domain-Id: default Jul 22 11:21:27.859931 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Domain-Name: Default Jul 22 11:21:27.859931 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Id: 691877dce1024aeda61629073d74602b Jul 22 11:21:27.859931 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Name: tempest-AttachVolumeNegativeTest-1017563372-project Jul 22 11:21:27.859931 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: method: > Jul 22 11:21:27.859931 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: exception: Instance 27286438-bce0-447c-9406-2d776cc7c81d could not be found. Jul 22 11:21:27.859931 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: action_args: {'id': '27286438-bce0-447c-9406-2d776cc7c81d'} Jul 22 11:21:27.861729 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 22 11:21:27.861729 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:21:27.861729 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 22 11:21:27.861729 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 22 11:21:27.861729 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 22 11:21:27.861729 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 22 11:21:27.861729 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 22 11:21:27.861729 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 22 11:21:27.861729 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 22 11:21:27.861729 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 22 11:21:27.861729 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27286438-bce0-447c-9406-2d776cc7c81d could not be found. Jul 22 11:21:27.861729 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:21:27.861729 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:21:27.861729 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:21:27.861729 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:21:27.861729 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:21:27.861729 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:21:27.861729 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 22 11:21:27.861729 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 22 11:21:27.861729 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 22 11:21:27.863986 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 22 11:21:27.863986 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 22 11:21:27.863986 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 22 11:21:27.863986 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 22 11:21:27.863986 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 22 11:21:27.863986 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 22 11:21:27.863986 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 22 11:21:27.863986 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 22 11:21:27.863986 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 22 11:21:27.863986 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27286438-bce0-447c-9406-2d776cc7c81d could not be found. Jul 22 11:21:27.863986 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:21:27.863986 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:21:27.863986 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:21:27.863986 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:21:27.863986 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:21:27.863986 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:21:27.863986 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 22 11:21:27.863986 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 22 11:21:27.863986 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27286438-bce0-447c-9406-2d776cc7c81d could not be found. Jul 22 11:21:27.863986 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:21:27.866451 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-cb3705f0-dae6-450f-bef4-ef342439c421 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Returning 404 to user: Instance 27286438-bce0-447c-9406-2d776cc7c81d could not be found. {{(pid=117884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 22 11:21:27.866451 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-cb3705f0-dae6-450f-bef4-ef342439c421 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "DELETE /compute/v2.1/servers/27286438-bce0-447c-9406-2d776cc7c81d" status: 404 len: 111 microversion: 2.1 time: 0.036349 Jul 22 11:21:27.866451 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 416/846] 10.222.0.20 () {58 vars in 1238 bytes} [Fri Jul 22 11:21:27 2022] DELETE /compute/v2.1/servers/27286438-bce0-447c-9406-2d776cc7c81d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 22 11:21:27.874617 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-b07986eb-b59e-4d7c-baf9-c9e99fc35efc tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:27.875624 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-b07986eb-b59e-4d7c-baf9-c9e99fc35efc tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 27286438-bce0-447c-9406-2d776cc7c81d] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:27.887481 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b07986eb-b59e-4d7c-baf9-c9e99fc35efc tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:27.888334 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b07986eb-b59e-4d7c-baf9-c9e99fc35efc tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:27.889997 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b07986eb-b59e-4d7c-baf9-c9e99fc35efc tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:27.890791 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b07986eb-b59e-4d7c-baf9-c9e99fc35efc tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:27.916264 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.wsgi [None req-b07986eb-b59e-4d7c-baf9-c9e99fc35efc tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] HTTP exception thrown: Instance 27286438-bce0-447c-9406-2d776cc7c81d could not be found. Jul 22 11:21:27.919017 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-b07986eb-b59e-4d7c-baf9-c9e99fc35efc tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Request method failure captured: Jul 22 11:21:27.919017 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: request: GET /compute/v2.1/servers/27286438-bce0-447c-9406-2d776cc7c81d HTTP/1.1 Jul 22 11:21:27.919017 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Accept: application/json Jul 22 11:21:27.919017 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Accept-Encoding: identity Jul 22 11:21:27.919017 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Connection: close Jul 22 11:21:27.919017 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Content-Length: 0 Jul 22 11:21:27.919017 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Content-Type: application/json Jul 22 11:21:27.919017 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Host: 10.222.0.20 Jul 22 11:21:27.919017 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Openstack-System-Scope: None Jul 22 11:21:27.919017 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: User-Agent: python-urllib3/1.26.9 Jul 22 11:21:27.919017 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Auth-Token: gAAAAABi2oZ52By6vC80uVvQ5nsWGLE19ZXI57S3ld1fjPibH8fuUYjCV8gJDPh42GzMe4RKMojTgGaj2CCjG1yohpK4Rm5k-mOJAFOmJU-P2lN4F8UiP8lUppBYVH0uVfdef6vJD72z_c72VmeWRwsVQhXxsOTWQe5Gh1G1aCThgwUg9CYgRRw Jul 22 11:21:27.919017 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Domain-Id: None Jul 22 11:21:27.919017 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Domain-Name: None Jul 22 11:21:27.919017 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Identity-Status: Confirmed Jul 22 11:21:27.919017 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Is-Admin-Project: True Jul 22 11:21:27.919017 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Project-Domain-Id: default Jul 22 11:21:27.919017 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Project-Domain-Name: Default Jul 22 11:21:27.919017 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Project-Id: 28836b7cb9c646aaaa1bb1c1fae68128 Jul 22 11:21:27.919017 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Project-Name: tempest-AttachVolumeNegativeTest-1017563372 Jul 22 11:21:27.919017 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Role: reader,member Jul 22 11:21:27.919017 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Roles: reader,member Jul 22 11:21:27.921169 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/28836b7cb9c646aaaa1bb1c1fae68128"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_28836b7cb9c646aaaa1bb1c1fae68128", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/28836b7cb9c646aaaa1bb1c1fae68128"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/28836b7cb9c646aaaa1bb1c1fae68128"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jul 22 11:21:27.921169 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Tenant: tempest-AttachVolumeNegativeTest-1017563372 Jul 22 11:21:27.921169 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Tenant-Id: 28836b7cb9c646aaaa1bb1c1fae68128 Jul 22 11:21:27.921169 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1017563372 Jul 22 11:21:27.921169 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User: tempest-AttachVolumeNegativeTest-1017563372-project Jul 22 11:21:27.921169 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User-Domain-Id: default Jul 22 11:21:27.921169 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User-Domain-Name: Default Jul 22 11:21:27.921169 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User-Id: 691877dce1024aeda61629073d74602b Jul 22 11:21:27.921169 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User-Name: tempest-AttachVolumeNegativeTest-1017563372-project Jul 22 11:21:27.921169 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: method: > Jul 22 11:21:27.921169 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: exception: Instance 27286438-bce0-447c-9406-2d776cc7c81d could not be found. Jul 22 11:21:27.921169 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: action_args: {'id': '27286438-bce0-447c-9406-2d776cc7c81d'} Jul 22 11:21:27.922169 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 22 11:21:27.922169 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:21:27.922169 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 22 11:21:27.922169 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 22 11:21:27.922169 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 22 11:21:27.922169 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 22 11:21:27.922169 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 22 11:21:27.922169 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 22 11:21:27.922169 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 22 11:21:27.922169 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 22 11:21:27.922169 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27286438-bce0-447c-9406-2d776cc7c81d could not be found. Jul 22 11:21:27.922169 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:21:27.922169 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:21:27.922169 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:21:27.922169 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:21:27.922169 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:21:27.922169 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:21:27.922169 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 22 11:21:27.922169 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 22 11:21:27.922169 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 22 11:21:27.923819 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 22 11:21:27.923819 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 22 11:21:27.923819 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 22 11:21:27.923819 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 22 11:21:27.923819 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 22 11:21:27.923819 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 22 11:21:27.923819 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 22 11:21:27.923819 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27286438-bce0-447c-9406-2d776cc7c81d could not be found. Jul 22 11:21:27.923819 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:21:27.923819 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:21:27.923819 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:21:27.923819 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:21:27.923819 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:21:27.923819 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:21:27.923819 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 22 11:21:27.923819 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 22 11:21:27.923819 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27286438-bce0-447c-9406-2d776cc7c81d could not be found. Jul 22 11:21:27.923819 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:21:27.928879 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-b07986eb-b59e-4d7c-baf9-c9e99fc35efc tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Returning 404 to user: Instance 27286438-bce0-447c-9406-2d776cc7c81d could not be found. {{(pid=117885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 22 11:21:27.936607 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-b07986eb-b59e-4d7c-baf9-c9e99fc35efc tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/27286438-bce0-447c-9406-2d776cc7c81d" status: 404 len: 111 microversion: 2.1 time: 0.068710 Jul 22 11:21:27.941486 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 431/847] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:21:27 2022] GET /compute/v2.1/servers/27286438-bce0-447c-9406-2d776cc7c81d => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 22 11:21:28.303711 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-262d9bbc-2aa9-4d84-8e02-f805c682dad4 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:28.305028 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-262d9bbc-2aa9-4d84-8e02-f805c682dad4 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: edc7a08a-180f-4907-9f8d-9d14bd9cf10c] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:28.312897 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-262d9bbc-2aa9-4d84-8e02-f805c682dad4 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:28.315326 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-262d9bbc-2aa9-4d84-8e02-f805c682dad4 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:28.317872 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-262d9bbc-2aa9-4d84-8e02-f805c682dad4 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:28.318940 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-262d9bbc-2aa9-4d84-8e02-f805c682dad4 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:28.552609 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-262d9bbc-2aa9-4d84-8e02-f805c682dad4 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:28.565635 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-262d9bbc-2aa9-4d84-8e02-f805c682dad4 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/edc7a08a-180f-4907-9f8d-9d14bd9cf10c" status: 200 len: 1673 microversion: 2.1 time: 0.267096 Jul 22 11:21:28.566493 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 417/848] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:21:28 2022] GET /compute/v2.1/servers/edc7a08a-180f-4907-9f8d-9d14bd9cf10c => generated 1673 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:21:28.842317 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-df63ded8-dc3c-4f47-aff0-10168065972c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:28.844126 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-df63ded8-dc3c-4f47-aff0-10168065972c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:28.853169 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-df63ded8-dc3c-4f47-aff0-10168065972c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:28.853851 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-df63ded8-dc3c-4f47-aff0-10168065972c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:28.855010 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-df63ded8-dc3c-4f47-aff0-10168065972c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:28.855683 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-df63ded8-dc3c-4f47-aff0-10168065972c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:29.100440 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-df63ded8-dc3c-4f47-aff0-10168065972c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:29.110252 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-df63ded8-dc3c-4f47-aff0-10168065972c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:29.118333 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-df63ded8-dc3c-4f47-aff0-10168065972c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:29.123426 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-df63ded8-dc3c-4f47-aff0-10168065972c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46" status: 200 len: 1740 microversion: 2.20 time: 0.284760 Jul 22 11:21:29.124782 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 432/849] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:21:28 2022] GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 => generated 1740 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:21:29.211418 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-1ad58dc3-d0cf-4cd6-8974-a1d5e670a5f0 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:29.212754 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-1ad58dc3-d0cf-4cd6-8974-a1d5e670a5f0 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 272976bd-b870-41a6-9bcd-598e1c9d34bc] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:29.220684 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-1ad58dc3-d0cf-4cd6-8974-a1d5e670a5f0 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:29.221669 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-1ad58dc3-d0cf-4cd6-8974-a1d5e670a5f0 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:29.222520 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-1ad58dc3-d0cf-4cd6-8974-a1d5e670a5f0 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:29.223549 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-1ad58dc3-d0cf-4cd6-8974-a1d5e670a5f0 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:29.242659 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.wsgi [None req-1ad58dc3-d0cf-4cd6-8974-a1d5e670a5f0 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] HTTP exception thrown: Instance 272976bd-b870-41a6-9bcd-598e1c9d34bc could not be found. Jul 22 11:21:29.244628 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-1ad58dc3-d0cf-4cd6-8974-a1d5e670a5f0 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Request method failure captured: Jul 22 11:21:29.244628 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: request: DELETE /compute/v2.1/servers/272976bd-b870-41a6-9bcd-598e1c9d34bc HTTP/1.1 Jul 22 11:21:29.244628 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Accept: application/json Jul 22 11:21:29.244628 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Accept-Encoding: identity Jul 22 11:21:29.244628 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Connection: close Jul 22 11:21:29.244628 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Content-Length: 0 Jul 22 11:21:29.244628 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Content-Type: application/json Jul 22 11:21:29.244628 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Host: 10.222.0.20 Jul 22 11:21:29.244628 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Openstack-System-Scope: None Jul 22 11:21:29.244628 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: User-Agent: python-urllib3/1.26.9 Jul 22 11:21:29.244628 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Auth-Token: gAAAAABi2oZ52By6vC80uVvQ5nsWGLE19ZXI57S3ld1fjPibH8fuUYjCV8gJDPh42GzMe4RKMojTgGaj2CCjG1yohpK4Rm5k-mOJAFOmJU-P2lN4F8UiP8lUppBYVH0uVfdef6vJD72z_c72VmeWRwsVQhXxsOTWQe5Gh1G1aCThgwUg9CYgRRw Jul 22 11:21:29.244628 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Domain-Id: None Jul 22 11:21:29.244628 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Domain-Name: None Jul 22 11:21:29.244628 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Identity-Status: Confirmed Jul 22 11:21:29.244628 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Is-Admin-Project: True Jul 22 11:21:29.244628 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Domain-Id: default Jul 22 11:21:29.244628 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Domain-Name: Default Jul 22 11:21:29.244628 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Id: 28836b7cb9c646aaaa1bb1c1fae68128 Jul 22 11:21:29.244628 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Name: tempest-AttachVolumeNegativeTest-1017563372 Jul 22 11:21:29.244628 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Role: reader,member Jul 22 11:21:29.244628 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Roles: reader,member Jul 22 11:21:29.246166 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/28836b7cb9c646aaaa1bb1c1fae68128"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_28836b7cb9c646aaaa1bb1c1fae68128", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/28836b7cb9c646aaaa1bb1c1fae68128"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/28836b7cb9c646aaaa1bb1c1fae68128"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jul 22 11:21:29.246166 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant: tempest-AttachVolumeNegativeTest-1017563372 Jul 22 11:21:29.246166 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant-Id: 28836b7cb9c646aaaa1bb1c1fae68128 Jul 22 11:21:29.246166 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1017563372 Jul 22 11:21:29.246166 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User: tempest-AttachVolumeNegativeTest-1017563372-project Jul 22 11:21:29.246166 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Domain-Id: default Jul 22 11:21:29.246166 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Domain-Name: Default Jul 22 11:21:29.246166 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Id: 691877dce1024aeda61629073d74602b Jul 22 11:21:29.246166 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Name: tempest-AttachVolumeNegativeTest-1017563372-project Jul 22 11:21:29.246166 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: method: > Jul 22 11:21:29.246166 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: exception: Instance 272976bd-b870-41a6-9bcd-598e1c9d34bc could not be found. Jul 22 11:21:29.246166 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: action_args: {'id': '272976bd-b870-41a6-9bcd-598e1c9d34bc'} Jul 22 11:21:29.247013 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 22 11:21:29.247013 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:21:29.247013 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 22 11:21:29.247013 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 22 11:21:29.247013 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 22 11:21:29.247013 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 22 11:21:29.247013 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 22 11:21:29.247013 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 22 11:21:29.247013 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 22 11:21:29.247013 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 22 11:21:29.247013 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 272976bd-b870-41a6-9bcd-598e1c9d34bc could not be found. Jul 22 11:21:29.247013 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:21:29.247013 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:21:29.247013 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:21:29.247013 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:21:29.247013 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:21:29.247013 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:21:29.247013 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 22 11:21:29.247013 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 22 11:21:29.247013 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 22 11:21:29.249959 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 22 11:21:29.249959 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 22 11:21:29.249959 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 22 11:21:29.249959 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 22 11:21:29.249959 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 22 11:21:29.249959 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 22 11:21:29.249959 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 22 11:21:29.249959 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 22 11:21:29.249959 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 22 11:21:29.249959 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 272976bd-b870-41a6-9bcd-598e1c9d34bc could not be found. Jul 22 11:21:29.249959 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:21:29.249959 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:21:29.249959 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:21:29.249959 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:21:29.249959 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:21:29.249959 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:21:29.249959 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 22 11:21:29.249959 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 22 11:21:29.249959 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 272976bd-b870-41a6-9bcd-598e1c9d34bc could not be found. Jul 22 11:21:29.249959 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:21:29.261761 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-1ad58dc3-d0cf-4cd6-8974-a1d5e670a5f0 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Returning 404 to user: Instance 272976bd-b870-41a6-9bcd-598e1c9d34bc could not be found. {{(pid=117884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 22 11:21:29.267454 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-1ad58dc3-d0cf-4cd6-8974-a1d5e670a5f0 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "DELETE /compute/v2.1/servers/272976bd-b870-41a6-9bcd-598e1c9d34bc" status: 404 len: 111 microversion: 2.1 time: 0.050815 Jul 22 11:21:29.268949 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 418/850] 10.222.0.20 () {58 vars in 1238 bytes} [Fri Jul 22 11:21:29 2022] DELETE /compute/v2.1/servers/272976bd-b870-41a6-9bcd-598e1c9d34bc => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 22 11:21:29.278137 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-71b841b4-80b9-4a36-bb16-2806f4ef20b8 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:29.279106 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-71b841b4-80b9-4a36-bb16-2806f4ef20b8 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 272976bd-b870-41a6-9bcd-598e1c9d34bc] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:29.287061 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-71b841b4-80b9-4a36-bb16-2806f4ef20b8 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:29.288304 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-71b841b4-80b9-4a36-bb16-2806f4ef20b8 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:29.289325 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-71b841b4-80b9-4a36-bb16-2806f4ef20b8 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:29.289995 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-71b841b4-80b9-4a36-bb16-2806f4ef20b8 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:29.309148 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.wsgi [None req-71b841b4-80b9-4a36-bb16-2806f4ef20b8 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] HTTP exception thrown: Instance 272976bd-b870-41a6-9bcd-598e1c9d34bc could not be found. Jul 22 11:21:29.310834 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-71b841b4-80b9-4a36-bb16-2806f4ef20b8 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Request method failure captured: Jul 22 11:21:29.310834 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: request: GET /compute/v2.1/servers/272976bd-b870-41a6-9bcd-598e1c9d34bc HTTP/1.1 Jul 22 11:21:29.310834 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Accept: application/json Jul 22 11:21:29.310834 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Accept-Encoding: identity Jul 22 11:21:29.310834 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Connection: close Jul 22 11:21:29.310834 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Content-Length: 0 Jul 22 11:21:29.310834 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Content-Type: application/json Jul 22 11:21:29.310834 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Host: 10.222.0.20 Jul 22 11:21:29.310834 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Openstack-System-Scope: None Jul 22 11:21:29.310834 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: User-Agent: python-urllib3/1.26.9 Jul 22 11:21:29.310834 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Auth-Token: gAAAAABi2oZ52By6vC80uVvQ5nsWGLE19ZXI57S3ld1fjPibH8fuUYjCV8gJDPh42GzMe4RKMojTgGaj2CCjG1yohpK4Rm5k-mOJAFOmJU-P2lN4F8UiP8lUppBYVH0uVfdef6vJD72z_c72VmeWRwsVQhXxsOTWQe5Gh1G1aCThgwUg9CYgRRw Jul 22 11:21:29.310834 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Domain-Id: None Jul 22 11:21:29.310834 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Domain-Name: None Jul 22 11:21:29.310834 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Identity-Status: Confirmed Jul 22 11:21:29.310834 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Is-Admin-Project: True Jul 22 11:21:29.310834 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Project-Domain-Id: default Jul 22 11:21:29.310834 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Project-Domain-Name: Default Jul 22 11:21:29.310834 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Project-Id: 28836b7cb9c646aaaa1bb1c1fae68128 Jul 22 11:21:29.310834 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Project-Name: tempest-AttachVolumeNegativeTest-1017563372 Jul 22 11:21:29.310834 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Role: reader,member Jul 22 11:21:29.310834 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Roles: reader,member Jul 22 11:21:29.312232 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/28836b7cb9c646aaaa1bb1c1fae68128"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_28836b7cb9c646aaaa1bb1c1fae68128", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/28836b7cb9c646aaaa1bb1c1fae68128"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/28836b7cb9c646aaaa1bb1c1fae68128"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jul 22 11:21:29.312232 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Tenant: tempest-AttachVolumeNegativeTest-1017563372 Jul 22 11:21:29.312232 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Tenant-Id: 28836b7cb9c646aaaa1bb1c1fae68128 Jul 22 11:21:29.312232 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1017563372 Jul 22 11:21:29.312232 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User: tempest-AttachVolumeNegativeTest-1017563372-project Jul 22 11:21:29.312232 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User-Domain-Id: default Jul 22 11:21:29.312232 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User-Domain-Name: Default Jul 22 11:21:29.312232 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User-Id: 691877dce1024aeda61629073d74602b Jul 22 11:21:29.312232 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User-Name: tempest-AttachVolumeNegativeTest-1017563372-project Jul 22 11:21:29.312232 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: method: > Jul 22 11:21:29.312232 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: exception: Instance 272976bd-b870-41a6-9bcd-598e1c9d34bc could not be found. Jul 22 11:21:29.312232 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: action_args: {'id': '272976bd-b870-41a6-9bcd-598e1c9d34bc'} Jul 22 11:21:29.312989 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 22 11:21:29.312989 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:21:29.312989 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 22 11:21:29.312989 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 22 11:21:29.312989 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 22 11:21:29.312989 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 22 11:21:29.312989 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 22 11:21:29.312989 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 22 11:21:29.312989 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 22 11:21:29.312989 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 22 11:21:29.312989 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 272976bd-b870-41a6-9bcd-598e1c9d34bc could not be found. Jul 22 11:21:29.312989 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:21:29.312989 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:21:29.312989 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:21:29.312989 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:21:29.312989 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:21:29.312989 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:21:29.312989 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 22 11:21:29.312989 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 22 11:21:29.312989 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 22 11:21:29.314167 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 22 11:21:29.314167 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 22 11:21:29.314167 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 22 11:21:29.314167 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 22 11:21:29.314167 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 22 11:21:29.314167 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 22 11:21:29.314167 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 22 11:21:29.314167 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 272976bd-b870-41a6-9bcd-598e1c9d34bc could not be found. Jul 22 11:21:29.314167 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:21:29.314167 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:21:29.314167 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:21:29.314167 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:21:29.314167 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:21:29.314167 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:21:29.314167 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 22 11:21:29.314167 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 22 11:21:29.314167 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 272976bd-b870-41a6-9bcd-598e1c9d34bc could not be found. Jul 22 11:21:29.314167 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:21:29.317694 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-71b841b4-80b9-4a36-bb16-2806f4ef20b8 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Returning 404 to user: Instance 272976bd-b870-41a6-9bcd-598e1c9d34bc could not be found. {{(pid=117885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 22 11:21:29.317694 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-71b841b4-80b9-4a36-bb16-2806f4ef20b8 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/272976bd-b870-41a6-9bcd-598e1c9d34bc" status: 404 len: 111 microversion: 2.1 time: 0.039855 Jul 22 11:21:29.317694 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 433/851] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:21:29 2022] GET /compute/v2.1/servers/272976bd-b870-41a6-9bcd-598e1c9d34bc => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 22 11:21:29.324478 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-54e9ea3f-d006-42aa-b227-c28b21aa4c25 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:29.325009 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-54e9ea3f-d006-42aa-b227-c28b21aa4c25 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: d50614d9-5b91-43b0-952b-d5ecc987e85a] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:29.337442 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-54e9ea3f-d006-42aa-b227-c28b21aa4c25 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:29.337890 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-54e9ea3f-d006-42aa-b227-c28b21aa4c25 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:29.338683 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-54e9ea3f-d006-42aa-b227-c28b21aa4c25 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:29.339114 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-54e9ea3f-d006-42aa-b227-c28b21aa4c25 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:29.370289 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.wsgi [None req-54e9ea3f-d006-42aa-b227-c28b21aa4c25 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] HTTP exception thrown: Instance d50614d9-5b91-43b0-952b-d5ecc987e85a could not be found. Jul 22 11:21:29.371882 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-54e9ea3f-d006-42aa-b227-c28b21aa4c25 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Request method failure captured: Jul 22 11:21:29.371882 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: request: DELETE /compute/v2.1/servers/d50614d9-5b91-43b0-952b-d5ecc987e85a HTTP/1.1 Jul 22 11:21:29.371882 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Accept: application/json Jul 22 11:21:29.371882 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Accept-Encoding: identity Jul 22 11:21:29.371882 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Connection: close Jul 22 11:21:29.371882 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Content-Length: 0 Jul 22 11:21:29.371882 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Content-Type: application/json Jul 22 11:21:29.371882 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Host: 10.222.0.20 Jul 22 11:21:29.371882 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Openstack-System-Scope: None Jul 22 11:21:29.371882 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: User-Agent: python-urllib3/1.26.9 Jul 22 11:21:29.371882 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Auth-Token: gAAAAABi2oZ52By6vC80uVvQ5nsWGLE19ZXI57S3ld1fjPibH8fuUYjCV8gJDPh42GzMe4RKMojTgGaj2CCjG1yohpK4Rm5k-mOJAFOmJU-P2lN4F8UiP8lUppBYVH0uVfdef6vJD72z_c72VmeWRwsVQhXxsOTWQe5Gh1G1aCThgwUg9CYgRRw Jul 22 11:21:29.371882 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Domain-Id: None Jul 22 11:21:29.371882 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Domain-Name: None Jul 22 11:21:29.371882 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Identity-Status: Confirmed Jul 22 11:21:29.371882 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Is-Admin-Project: True Jul 22 11:21:29.371882 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Domain-Id: default Jul 22 11:21:29.371882 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Domain-Name: Default Jul 22 11:21:29.371882 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Id: 28836b7cb9c646aaaa1bb1c1fae68128 Jul 22 11:21:29.371882 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Name: tempest-AttachVolumeNegativeTest-1017563372 Jul 22 11:21:29.371882 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Role: reader,member Jul 22 11:21:29.371882 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Roles: reader,member Jul 22 11:21:29.373214 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/28836b7cb9c646aaaa1bb1c1fae68128"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_28836b7cb9c646aaaa1bb1c1fae68128", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/28836b7cb9c646aaaa1bb1c1fae68128"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/28836b7cb9c646aaaa1bb1c1fae68128"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jul 22 11:21:29.373214 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant: tempest-AttachVolumeNegativeTest-1017563372 Jul 22 11:21:29.373214 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant-Id: 28836b7cb9c646aaaa1bb1c1fae68128 Jul 22 11:21:29.373214 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1017563372 Jul 22 11:21:29.373214 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User: tempest-AttachVolumeNegativeTest-1017563372-project Jul 22 11:21:29.373214 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Domain-Id: default Jul 22 11:21:29.373214 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Domain-Name: Default Jul 22 11:21:29.373214 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Id: 691877dce1024aeda61629073d74602b Jul 22 11:21:29.373214 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Name: tempest-AttachVolumeNegativeTest-1017563372-project Jul 22 11:21:29.373214 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: method: > Jul 22 11:21:29.373214 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: exception: Instance d50614d9-5b91-43b0-952b-d5ecc987e85a could not be found. Jul 22 11:21:29.373214 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: action_args: {'id': 'd50614d9-5b91-43b0-952b-d5ecc987e85a'} Jul 22 11:21:29.374018 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 22 11:21:29.374018 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:21:29.374018 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 22 11:21:29.374018 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 22 11:21:29.374018 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 22 11:21:29.374018 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 22 11:21:29.374018 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 22 11:21:29.374018 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 22 11:21:29.374018 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 22 11:21:29.374018 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 22 11:21:29.374018 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d50614d9-5b91-43b0-952b-d5ecc987e85a could not be found. Jul 22 11:21:29.374018 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:21:29.374018 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:21:29.374018 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:21:29.374018 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:21:29.374018 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:21:29.374018 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:21:29.374018 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 22 11:21:29.374018 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 22 11:21:29.374018 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 22 11:21:29.375789 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 22 11:21:29.375789 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 22 11:21:29.375789 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 22 11:21:29.375789 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 22 11:21:29.375789 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 22 11:21:29.375789 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 22 11:21:29.375789 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 22 11:21:29.375789 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 22 11:21:29.375789 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 22 11:21:29.375789 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d50614d9-5b91-43b0-952b-d5ecc987e85a could not be found. Jul 22 11:21:29.375789 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:21:29.375789 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:21:29.375789 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:21:29.375789 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:21:29.375789 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:21:29.375789 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:21:29.375789 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 22 11:21:29.375789 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 22 11:21:29.375789 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d50614d9-5b91-43b0-952b-d5ecc987e85a could not be found. Jul 22 11:21:29.375789 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:21:29.378282 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-54e9ea3f-d006-42aa-b227-c28b21aa4c25 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Returning 404 to user: Instance d50614d9-5b91-43b0-952b-d5ecc987e85a could not be found. {{(pid=117884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 22 11:21:29.378282 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-54e9ea3f-d006-42aa-b227-c28b21aa4c25 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d50614d9-5b91-43b0-952b-d5ecc987e85a" status: 404 len: 111 microversion: 2.1 time: 0.053246 Jul 22 11:21:29.378282 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 419/852] 10.222.0.20 () {58 vars in 1238 bytes} [Fri Jul 22 11:21:29 2022] DELETE /compute/v2.1/servers/d50614d9-5b91-43b0-952b-d5ecc987e85a => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 22 11:21:29.382596 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-9d25f282-7eb8-407b-8c9d-246c0e948d70 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:29.383220 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-9d25f282-7eb8-407b-8c9d-246c0e948d70 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: d50614d9-5b91-43b0-952b-d5ecc987e85a] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:29.389682 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9d25f282-7eb8-407b-8c9d-246c0e948d70 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:29.390131 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9d25f282-7eb8-407b-8c9d-246c0e948d70 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:29.390936 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9d25f282-7eb8-407b-8c9d-246c0e948d70 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:29.391396 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9d25f282-7eb8-407b-8c9d-246c0e948d70 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:29.429037 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.wsgi [None req-9d25f282-7eb8-407b-8c9d-246c0e948d70 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] HTTP exception thrown: Instance d50614d9-5b91-43b0-952b-d5ecc987e85a could not be found. Jul 22 11:21:29.433027 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-9d25f282-7eb8-407b-8c9d-246c0e948d70 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Request method failure captured: Jul 22 11:21:29.433027 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: request: GET /compute/v2.1/servers/d50614d9-5b91-43b0-952b-d5ecc987e85a HTTP/1.1 Jul 22 11:21:29.433027 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Accept: application/json Jul 22 11:21:29.433027 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Accept-Encoding: identity Jul 22 11:21:29.433027 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Connection: close Jul 22 11:21:29.433027 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Content-Length: 0 Jul 22 11:21:29.433027 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Content-Type: application/json Jul 22 11:21:29.433027 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Host: 10.222.0.20 Jul 22 11:21:29.433027 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Openstack-System-Scope: None Jul 22 11:21:29.433027 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: User-Agent: python-urllib3/1.26.9 Jul 22 11:21:29.433027 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Auth-Token: gAAAAABi2oZ52By6vC80uVvQ5nsWGLE19ZXI57S3ld1fjPibH8fuUYjCV8gJDPh42GzMe4RKMojTgGaj2CCjG1yohpK4Rm5k-mOJAFOmJU-P2lN4F8UiP8lUppBYVH0uVfdef6vJD72z_c72VmeWRwsVQhXxsOTWQe5Gh1G1aCThgwUg9CYgRRw Jul 22 11:21:29.433027 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Domain-Id: None Jul 22 11:21:29.433027 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Domain-Name: None Jul 22 11:21:29.433027 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Identity-Status: Confirmed Jul 22 11:21:29.433027 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Is-Admin-Project: True Jul 22 11:21:29.433027 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Project-Domain-Id: default Jul 22 11:21:29.433027 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Project-Domain-Name: Default Jul 22 11:21:29.433027 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Project-Id: 28836b7cb9c646aaaa1bb1c1fae68128 Jul 22 11:21:29.433027 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Project-Name: tempest-AttachVolumeNegativeTest-1017563372 Jul 22 11:21:29.433027 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Role: reader,member Jul 22 11:21:29.433027 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Roles: reader,member Jul 22 11:21:29.434491 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/28836b7cb9c646aaaa1bb1c1fae68128"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_28836b7cb9c646aaaa1bb1c1fae68128", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/28836b7cb9c646aaaa1bb1c1fae68128"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/28836b7cb9c646aaaa1bb1c1fae68128"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jul 22 11:21:29.434491 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Tenant: tempest-AttachVolumeNegativeTest-1017563372 Jul 22 11:21:29.434491 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Tenant-Id: 28836b7cb9c646aaaa1bb1c1fae68128 Jul 22 11:21:29.434491 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1017563372 Jul 22 11:21:29.434491 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User: tempest-AttachVolumeNegativeTest-1017563372-project Jul 22 11:21:29.434491 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User-Domain-Id: default Jul 22 11:21:29.434491 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User-Domain-Name: Default Jul 22 11:21:29.434491 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User-Id: 691877dce1024aeda61629073d74602b Jul 22 11:21:29.434491 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User-Name: tempest-AttachVolumeNegativeTest-1017563372-project Jul 22 11:21:29.434491 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: method: > Jul 22 11:21:29.434491 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: exception: Instance d50614d9-5b91-43b0-952b-d5ecc987e85a could not be found. Jul 22 11:21:29.434491 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: action_args: {'id': 'd50614d9-5b91-43b0-952b-d5ecc987e85a'} Jul 22 11:21:29.435868 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 22 11:21:29.435868 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:21:29.435868 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 22 11:21:29.435868 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 22 11:21:29.435868 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 22 11:21:29.435868 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 22 11:21:29.435868 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 22 11:21:29.435868 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 22 11:21:29.435868 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 22 11:21:29.435868 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 22 11:21:29.435868 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d50614d9-5b91-43b0-952b-d5ecc987e85a could not be found. Jul 22 11:21:29.435868 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:21:29.435868 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:21:29.435868 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:21:29.435868 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:21:29.435868 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:21:29.435868 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:21:29.435868 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 22 11:21:29.435868 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 22 11:21:29.435868 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 22 11:21:29.437072 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 22 11:21:29.437072 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 22 11:21:29.437072 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 22 11:21:29.437072 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 22 11:21:29.437072 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 22 11:21:29.437072 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 22 11:21:29.437072 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 22 11:21:29.437072 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d50614d9-5b91-43b0-952b-d5ecc987e85a could not be found. Jul 22 11:21:29.437072 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:21:29.437072 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:21:29.437072 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:21:29.437072 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:21:29.437072 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:21:29.437072 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:21:29.437072 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 22 11:21:29.437072 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 22 11:21:29.437072 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d50614d9-5b91-43b0-952b-d5ecc987e85a could not be found. Jul 22 11:21:29.437072 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:21:29.438147 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-9d25f282-7eb8-407b-8c9d-246c0e948d70 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Returning 404 to user: Instance d50614d9-5b91-43b0-952b-d5ecc987e85a could not be found. {{(pid=117885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 22 11:21:29.438147 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-9d25f282-7eb8-407b-8c9d-246c0e948d70 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/d50614d9-5b91-43b0-952b-d5ecc987e85a" status: 404 len: 111 microversion: 2.1 time: 0.056289 Jul 22 11:21:29.438147 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 434/853] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:21:29 2022] GET /compute/v2.1/servers/d50614d9-5b91-43b0-952b-d5ecc987e85a => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 22 11:21:29.584238 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-e34a83c0-eec2-4338-88aa-f156d0734a51 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:29.584858 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-e34a83c0-eec2-4338-88aa-f156d0734a51 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: edc7a08a-180f-4907-9f8d-9d14bd9cf10c] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:29.605043 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-e34a83c0-eec2-4338-88aa-f156d0734a51 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:29.605497 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-e34a83c0-eec2-4338-88aa-f156d0734a51 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:29.606281 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-e34a83c0-eec2-4338-88aa-f156d0734a51 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:29.606716 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-e34a83c0-eec2-4338-88aa-f156d0734a51 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:29.744369 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-e34a83c0-eec2-4338-88aa-f156d0734a51 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da75b78b267f47e8aaaafb41e3acb61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50a15db11214fb5a637fb400dcd928f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:29.756466 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-e34a83c0-eec2-4338-88aa-f156d0734a51 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/edc7a08a-180f-4907-9f8d-9d14bd9cf10c" status: 200 len: 1605 microversion: 2.1 time: 0.176273 Jul 22 11:21:29.768664 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 420/854] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:21:29 2022] GET /compute/v2.1/servers/edc7a08a-180f-4907-9f8d-9d14bd9cf10c => generated 1605 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:21:29.883429 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-9175cd6f-9f6c-4433-93a8-8e2056c3a873 req-9b7c21a1-0343-41de-bd1d-820d1a445c7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edc7a08a-180f-4907-9f8d-9d14bd9cf10c", "name": "network-vif-deleted", "tag": "bf7a4ec0-a612-481f-81ec-02d77677b359"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:21:29.908940 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-9175cd6f-9f6c-4433-93a8-8e2056c3a873 req-9b7c21a1-0343-41de-bd1d-820d1a445c7e service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:29.909909 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-9175cd6f-9f6c-4433-93a8-8e2056c3a873 req-9b7c21a1-0343-41de-bd1d-820d1a445c7e service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:29.932129 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-9175cd6f-9f6c-4433-93a8-8e2056c3a873 req-9b7c21a1-0343-41de-bd1d-820d1a445c7e service nova] Creating event network-vif-deleted:bf7a4ec0-a612-481f-81ec-02d77677b359 for instance edc7a08a-180f-4907-9f8d-9d14bd9cf10c on hv-cinder-84890 Jul 22 11:21:29.939959 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-9175cd6f-9f6c-4433-93a8-8e2056c3a873 req-9b7c21a1-0343-41de-bd1d-820d1a445c7e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059885 Jul 22 11:21:29.940864 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 435/855] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:21:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:21:30.146330 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-18791d57-cd08-4942-a91c-74683415b10c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:30.147890 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-18791d57-cd08-4942-a91c-74683415b10c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:30.164689 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-18791d57-cd08-4942-a91c-74683415b10c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:30.165237 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-18791d57-cd08-4942-a91c-74683415b10c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:30.166479 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-18791d57-cd08-4942-a91c-74683415b10c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:30.166735 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-18791d57-cd08-4942-a91c-74683415b10c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:30.171622 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG dbcounter [-] [117884] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:21:30.380541 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-18791d57-cd08-4942-a91c-74683415b10c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:30.390149 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-18791d57-cd08-4942-a91c-74683415b10c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:30.392233 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-18791d57-cd08-4942-a91c-74683415b10c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:30.394431 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-18791d57-cd08-4942-a91c-74683415b10c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46" status: 200 len: 1740 microversion: 2.20 time: 0.252552 Jul 22 11:21:30.406744 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 421/856] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:21:30 2022] GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 => generated 1740 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:21:30.648680 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-ace3bb9b-7f7f-43d2-b027-5c70da1061c2 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:30.649913 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-ace3bb9b-7f7f-43d2-b027-5c70da1061c2 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 0501f722-7553-4cba-9675-7bcbabb72887] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:30.657118 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ace3bb9b-7f7f-43d2-b027-5c70da1061c2 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:30.657667 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ace3bb9b-7f7f-43d2-b027-5c70da1061c2 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:30.659287 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ace3bb9b-7f7f-43d2-b027-5c70da1061c2 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:30.660142 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ace3bb9b-7f7f-43d2-b027-5c70da1061c2 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:30.675652 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.wsgi [None req-ace3bb9b-7f7f-43d2-b027-5c70da1061c2 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] HTTP exception thrown: Instance 0501f722-7553-4cba-9675-7bcbabb72887 could not be found. Jul 22 11:21:30.677477 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-ace3bb9b-7f7f-43d2-b027-5c70da1061c2 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Request method failure captured: Jul 22 11:21:30.677477 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: request: DELETE /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887 HTTP/1.1 Jul 22 11:21:30.677477 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Accept: application/json Jul 22 11:21:30.677477 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Accept-Encoding: identity Jul 22 11:21:30.677477 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Connection: close Jul 22 11:21:30.677477 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Content-Length: 0 Jul 22 11:21:30.677477 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Content-Type: application/json Jul 22 11:21:30.677477 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Host: 10.222.0.20 Jul 22 11:21:30.677477 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Openstack-System-Scope: None Jul 22 11:21:30.677477 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: User-Agent: python-urllib3/1.26.9 Jul 22 11:21:30.677477 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Auth-Token: gAAAAABi2oZ52By6vC80uVvQ5nsWGLE19ZXI57S3ld1fjPibH8fuUYjCV8gJDPh42GzMe4RKMojTgGaj2CCjG1yohpK4Rm5k-mOJAFOmJU-P2lN4F8UiP8lUppBYVH0uVfdef6vJD72z_c72VmeWRwsVQhXxsOTWQe5Gh1G1aCThgwUg9CYgRRw Jul 22 11:21:30.677477 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Domain-Id: None Jul 22 11:21:30.677477 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Domain-Name: None Jul 22 11:21:30.677477 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Identity-Status: Confirmed Jul 22 11:21:30.677477 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Is-Admin-Project: True Jul 22 11:21:30.677477 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Project-Domain-Id: default Jul 22 11:21:30.677477 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Project-Domain-Name: Default Jul 22 11:21:30.677477 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Project-Id: 28836b7cb9c646aaaa1bb1c1fae68128 Jul 22 11:21:30.677477 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Project-Name: tempest-AttachVolumeNegativeTest-1017563372 Jul 22 11:21:30.677477 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Role: reader,member Jul 22 11:21:30.677477 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Roles: reader,member Jul 22 11:21:30.678790 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/28836b7cb9c646aaaa1bb1c1fae68128"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_28836b7cb9c646aaaa1bb1c1fae68128", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/28836b7cb9c646aaaa1bb1c1fae68128"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/28836b7cb9c646aaaa1bb1c1fae68128"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jul 22 11:21:30.678790 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Tenant: tempest-AttachVolumeNegativeTest-1017563372 Jul 22 11:21:30.678790 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Tenant-Id: 28836b7cb9c646aaaa1bb1c1fae68128 Jul 22 11:21:30.678790 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1017563372 Jul 22 11:21:30.678790 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User: tempest-AttachVolumeNegativeTest-1017563372-project Jul 22 11:21:30.678790 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User-Domain-Id: default Jul 22 11:21:30.678790 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User-Domain-Name: Default Jul 22 11:21:30.678790 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User-Id: 691877dce1024aeda61629073d74602b Jul 22 11:21:30.678790 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User-Name: tempest-AttachVolumeNegativeTest-1017563372-project Jul 22 11:21:30.678790 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: method: > Jul 22 11:21:30.678790 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: exception: Instance 0501f722-7553-4cba-9675-7bcbabb72887 could not be found. Jul 22 11:21:30.678790 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: action_args: {'id': '0501f722-7553-4cba-9675-7bcbabb72887'} Jul 22 11:21:30.679547 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 22 11:21:30.679547 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:21:30.679547 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 22 11:21:30.679547 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 22 11:21:30.679547 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 22 11:21:30.679547 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 22 11:21:30.679547 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 22 11:21:30.679547 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 22 11:21:30.679547 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 22 11:21:30.679547 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 22 11:21:30.679547 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0501f722-7553-4cba-9675-7bcbabb72887 could not be found. Jul 22 11:21:30.679547 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:21:30.679547 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:21:30.679547 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:21:30.679547 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:21:30.679547 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:21:30.679547 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:21:30.679547 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 22 11:21:30.679547 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 22 11:21:30.679547 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 22 11:21:30.681177 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 22 11:21:30.681177 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 22 11:21:30.681177 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 22 11:21:30.681177 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 22 11:21:30.681177 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 22 11:21:30.681177 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 22 11:21:30.681177 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 22 11:21:30.681177 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 22 11:21:30.681177 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 22 11:21:30.681177 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0501f722-7553-4cba-9675-7bcbabb72887 could not be found. Jul 22 11:21:30.681177 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:21:30.681177 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:21:30.681177 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:21:30.681177 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:21:30.681177 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:21:30.681177 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:21:30.681177 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 22 11:21:30.681177 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 22 11:21:30.681177 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0501f722-7553-4cba-9675-7bcbabb72887 could not be found. Jul 22 11:21:30.681177 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:21:30.682900 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-ace3bb9b-7f7f-43d2-b027-5c70da1061c2 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Returning 404 to user: Instance 0501f722-7553-4cba-9675-7bcbabb72887 could not be found. {{(pid=117885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 22 11:21:30.682900 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-ace3bb9b-7f7f-43d2-b027-5c70da1061c2 tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887" status: 404 len: 111 microversion: 2.1 time: 0.037145 Jul 22 11:21:30.683176 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 436/857] 10.222.0.20 () {58 vars in 1238 bytes} [Fri Jul 22 11:21:30 2022] DELETE /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 22 11:21:30.688263 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-7f50f446-c59b-40cb-b5ba-ca8d9d6a96ab tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:30.688889 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-7f50f446-c59b-40cb-b5ba-ca8d9d6a96ab tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] [instance: 0501f722-7553-4cba-9675-7bcbabb72887] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:30.696287 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-7f50f446-c59b-40cb-b5ba-ca8d9d6a96ab tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:30.696848 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-7f50f446-c59b-40cb-b5ba-ca8d9d6a96ab tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:30.697722 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-7f50f446-c59b-40cb-b5ba-ca8d9d6a96ab tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:30.698226 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-7f50f446-c59b-40cb-b5ba-ca8d9d6a96ab tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:30.720154 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.wsgi [None req-7f50f446-c59b-40cb-b5ba-ca8d9d6a96ab tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] HTTP exception thrown: Instance 0501f722-7553-4cba-9675-7bcbabb72887 could not be found. Jul 22 11:21:30.723365 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-7f50f446-c59b-40cb-b5ba-ca8d9d6a96ab tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Request method failure captured: Jul 22 11:21:30.723365 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: request: GET /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887 HTTP/1.1 Jul 22 11:21:30.723365 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Accept: application/json Jul 22 11:21:30.723365 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Accept-Encoding: identity Jul 22 11:21:30.723365 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Connection: close Jul 22 11:21:30.723365 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Content-Length: 0 Jul 22 11:21:30.723365 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Content-Type: application/json Jul 22 11:21:30.723365 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Host: 10.222.0.20 Jul 22 11:21:30.723365 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Openstack-System-Scope: None Jul 22 11:21:30.723365 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: User-Agent: python-urllib3/1.26.9 Jul 22 11:21:30.723365 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Auth-Token: gAAAAABi2oZ52By6vC80uVvQ5nsWGLE19ZXI57S3ld1fjPibH8fuUYjCV8gJDPh42GzMe4RKMojTgGaj2CCjG1yohpK4Rm5k-mOJAFOmJU-P2lN4F8UiP8lUppBYVH0uVfdef6vJD72z_c72VmeWRwsVQhXxsOTWQe5Gh1G1aCThgwUg9CYgRRw Jul 22 11:21:30.723365 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Domain-Id: None Jul 22 11:21:30.723365 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Domain-Name: None Jul 22 11:21:30.723365 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Identity-Status: Confirmed Jul 22 11:21:30.723365 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Is-Admin-Project: True Jul 22 11:21:30.723365 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Domain-Id: default Jul 22 11:21:30.723365 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Domain-Name: Default Jul 22 11:21:30.723365 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Id: 28836b7cb9c646aaaa1bb1c1fae68128 Jul 22 11:21:30.723365 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Name: tempest-AttachVolumeNegativeTest-1017563372 Jul 22 11:21:30.723365 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Role: reader,member Jul 22 11:21:30.723365 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Roles: reader,member Jul 22 11:21:30.724936 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/28836b7cb9c646aaaa1bb1c1fae68128"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_28836b7cb9c646aaaa1bb1c1fae68128", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/28836b7cb9c646aaaa1bb1c1fae68128"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/28836b7cb9c646aaaa1bb1c1fae68128"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jul 22 11:21:30.724936 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant: tempest-AttachVolumeNegativeTest-1017563372 Jul 22 11:21:30.724936 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant-Id: 28836b7cb9c646aaaa1bb1c1fae68128 Jul 22 11:21:30.724936 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1017563372 Jul 22 11:21:30.724936 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User: tempest-AttachVolumeNegativeTest-1017563372-project Jul 22 11:21:30.724936 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Domain-Id: default Jul 22 11:21:30.724936 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Domain-Name: Default Jul 22 11:21:30.724936 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Id: 691877dce1024aeda61629073d74602b Jul 22 11:21:30.724936 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Name: tempest-AttachVolumeNegativeTest-1017563372-project Jul 22 11:21:30.724936 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: method: > Jul 22 11:21:30.724936 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: exception: Instance 0501f722-7553-4cba-9675-7bcbabb72887 could not be found. Jul 22 11:21:30.724936 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: action_args: {'id': '0501f722-7553-4cba-9675-7bcbabb72887'} Jul 22 11:21:30.725666 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 22 11:21:30.725666 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:21:30.725666 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 22 11:21:30.725666 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 22 11:21:30.725666 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 22 11:21:30.725666 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 22 11:21:30.725666 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 22 11:21:30.725666 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 22 11:21:30.725666 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 22 11:21:30.725666 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 22 11:21:30.725666 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0501f722-7553-4cba-9675-7bcbabb72887 could not be found. Jul 22 11:21:30.725666 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:21:30.725666 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:21:30.725666 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:21:30.725666 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:21:30.725666 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:21:30.725666 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:21:30.725666 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 22 11:21:30.725666 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 22 11:21:30.725666 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 22 11:21:30.727068 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 22 11:21:30.727068 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 22 11:21:30.727068 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 22 11:21:30.727068 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 22 11:21:30.727068 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 22 11:21:30.727068 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 22 11:21:30.727068 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 22 11:21:30.727068 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0501f722-7553-4cba-9675-7bcbabb72887 could not be found. Jul 22 11:21:30.727068 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:21:30.727068 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:21:30.727068 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:21:30.727068 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:21:30.727068 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:21:30.727068 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:21:30.727068 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 22 11:21:30.727068 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 22 11:21:30.727068 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0501f722-7553-4cba-9675-7bcbabb72887 could not be found. Jul 22 11:21:30.727068 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:21:30.737262 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-7f50f446-c59b-40cb-b5ba-ca8d9d6a96ab tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] Returning 404 to user: Instance 0501f722-7553-4cba-9675-7bcbabb72887 could not be found. {{(pid=117884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 22 11:21:30.738266 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-7f50f446-c59b-40cb-b5ba-ca8d9d6a96ab tempest-AttachVolumeNegativeTest-1017563372 tempest-AttachVolumeNegativeTest-1017563372-project] 10.222.0.20 "GET /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887" status: 404 len: 111 microversion: 2.1 time: 0.054301 Jul 22 11:21:30.743017 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 422/858] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:21:30 2022] GET /compute/v2.1/servers/0501f722-7553-4cba-9675-7bcbabb72887 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 22 11:21:30.784335 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-05f304c7-578a-45ad-8b4c-7ee966835bf2 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:30.785074 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-05f304c7-578a-45ad-8b4c-7ee966835bf2 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: edc7a08a-180f-4907-9f8d-9d14bd9cf10c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:30.796713 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-05f304c7-578a-45ad-8b4c-7ee966835bf2 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:30.799804 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-05f304c7-578a-45ad-8b4c-7ee966835bf2 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:30.801936 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-05f304c7-578a-45ad-8b4c-7ee966835bf2 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:30.803664 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-05f304c7-578a-45ad-8b4c-7ee966835bf2 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:30.835594 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.wsgi [None req-05f304c7-578a-45ad-8b4c-7ee966835bf2 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] HTTP exception thrown: Instance edc7a08a-180f-4907-9f8d-9d14bd9cf10c could not be found. Jul 22 11:21:30.837913 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-05f304c7-578a-45ad-8b4c-7ee966835bf2 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Request method failure captured: Jul 22 11:21:30.837913 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: request: GET /compute/v2.1/servers/edc7a08a-180f-4907-9f8d-9d14bd9cf10c HTTP/1.1 Jul 22 11:21:30.837913 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Accept: application/json Jul 22 11:21:30.837913 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Accept-Encoding: identity Jul 22 11:21:30.837913 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Connection: close Jul 22 11:21:30.837913 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Content-Length: 0 Jul 22 11:21:30.837913 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Content-Type: application/json Jul 22 11:21:30.837913 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Host: 10.222.0.20 Jul 22 11:21:30.837913 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Openstack-System-Scope: None Jul 22 11:21:30.837913 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: User-Agent: python-urllib3/1.26.9 Jul 22 11:21:30.837913 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Auth-Token: gAAAAABi2oaCb6ZjdjoanfH_h9JPTqUp87mECBfq6-I-9jVCGnbw8DfIWpDq0WQ-nwPfGPDYfE40GlNjoCi25niz0gIt1tm70rKYhZ61iiEYO1DvkXJrAD9ZDO725FdcAppHCkweptc0h1Fo_PqV4DqPUPDrspxgeORVq6BMRXo9ntRdE9YcA4Y Jul 22 11:21:30.837913 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Domain-Id: None Jul 22 11:21:30.837913 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Domain-Name: None Jul 22 11:21:30.837913 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Identity-Status: Confirmed Jul 22 11:21:30.837913 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Is-Admin-Project: True Jul 22 11:21:30.837913 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Project-Domain-Id: default Jul 22 11:21:30.837913 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Project-Domain-Name: Default Jul 22 11:21:30.837913 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Project-Id: f50a15db11214fb5a637fb400dcd928f Jul 22 11:21:30.837913 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Project-Name: tempest-AttachVolumeTestJSON-127223071 Jul 22 11:21:30.837913 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Role: reader,member Jul 22 11:21:30.837913 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Roles: reader,member Jul 22 11:21:30.839336 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f50a15db11214fb5a637fb400dcd928f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f50a15db11214fb5a637fb400dcd928f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f50a15db11214fb5a637fb400dcd928f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f50a15db11214fb5a637fb400dcd928f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jul 22 11:21:30.839336 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Tenant: tempest-AttachVolumeTestJSON-127223071 Jul 22 11:21:30.839336 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Tenant-Id: f50a15db11214fb5a637fb400dcd928f Jul 22 11:21:30.839336 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Tenant-Name: tempest-AttachVolumeTestJSON-127223071 Jul 22 11:21:30.839336 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User: tempest-AttachVolumeTestJSON-127223071-project Jul 22 11:21:30.839336 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User-Domain-Id: default Jul 22 11:21:30.839336 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User-Domain-Name: Default Jul 22 11:21:30.839336 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User-Id: da75b78b267f47e8aaaafb41e3acb61a Jul 22 11:21:30.839336 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User-Name: tempest-AttachVolumeTestJSON-127223071-project Jul 22 11:21:30.839336 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: method: > Jul 22 11:21:30.839336 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: exception: Instance edc7a08a-180f-4907-9f8d-9d14bd9cf10c could not be found. Jul 22 11:21:30.839336 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: action_args: {'id': 'edc7a08a-180f-4907-9f8d-9d14bd9cf10c'} Jul 22 11:21:30.840109 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 22 11:21:30.840109 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:21:30.840109 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 22 11:21:30.840109 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 22 11:21:30.840109 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 22 11:21:30.840109 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 22 11:21:30.840109 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 22 11:21:30.840109 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 22 11:21:30.840109 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 22 11:21:30.840109 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 22 11:21:30.840109 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edc7a08a-180f-4907-9f8d-9d14bd9cf10c could not be found. Jul 22 11:21:30.840109 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:21:30.840109 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:21:30.840109 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:21:30.840109 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:21:30.840109 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:21:30.840109 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:21:30.840109 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 22 11:21:30.840109 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 22 11:21:30.840109 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 22 11:21:30.844944 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 22 11:21:30.844944 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 22 11:21:30.844944 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 22 11:21:30.844944 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 22 11:21:30.844944 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 22 11:21:30.844944 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 22 11:21:30.844944 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 22 11:21:30.844944 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edc7a08a-180f-4907-9f8d-9d14bd9cf10c could not be found. Jul 22 11:21:30.844944 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:21:30.844944 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:21:30.844944 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:21:30.844944 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:21:30.844944 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:21:30.844944 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:21:30.844944 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 22 11:21:30.844944 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 22 11:21:30.844944 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edc7a08a-180f-4907-9f8d-9d14bd9cf10c could not be found. Jul 22 11:21:30.844944 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:21:30.846574 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-05f304c7-578a-45ad-8b4c-7ee966835bf2 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Returning 404 to user: Instance edc7a08a-180f-4907-9f8d-9d14bd9cf10c could not be found. {{(pid=117885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 22 11:21:30.846574 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-05f304c7-578a-45ad-8b4c-7ee966835bf2 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/edc7a08a-180f-4907-9f8d-9d14bd9cf10c" status: 404 len: 111 microversion: 2.1 time: 0.059222 Jul 22 11:21:30.846574 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 437/859] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:21:30 2022] GET /compute/v2.1/servers/edc7a08a-180f-4907-9f8d-9d14bd9cf10c => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 22 11:21:30.851325 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-805b3d31-ced0-41c3-a19c-cffff002402e tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '.version_select at 0x7f84450c7ee0>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:30.961961 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-805b3d31-ced0-41c3-a19c-cffff002402e tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-848028287" status: 202 len: 0 microversion: 2.1 time: 0.116898 Jul 22 11:21:30.971640 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 423/860] 10.222.0.20 () {58 vars in 1217 bytes} [Fri Jul 22 11:21:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-848028287 => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 22 11:21:31.428068 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-84966bda-59cb-49d3-9a19-bd2b0aaaa570 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:31.429009 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-84966bda-59cb-49d3-9a19-bd2b0aaaa570 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:31.462931 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-84966bda-59cb-49d3-9a19-bd2b0aaaa570 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:31.468189 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-84966bda-59cb-49d3-9a19-bd2b0aaaa570 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:31.471468 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-84966bda-59cb-49d3-9a19-bd2b0aaaa570 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:31.476610 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-84966bda-59cb-49d3-9a19-bd2b0aaaa570 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:31.705697 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-84966bda-59cb-49d3-9a19-bd2b0aaaa570 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:31.714843 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-84966bda-59cb-49d3-9a19-bd2b0aaaa570 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:31.717449 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-84966bda-59cb-49d3-9a19-bd2b0aaaa570 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:31.721565 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-84966bda-59cb-49d3-9a19-bd2b0aaaa570 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46" status: 200 len: 1740 microversion: 2.20 time: 0.306050 Jul 22 11:21:31.722753 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 438/861] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:21:31 2022] GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 => generated 1740 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:21:32.750757 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-b1633c63-34ff-4269-98a2-3a4169a07eac tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:32.758306 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-b1633c63-34ff-4269-98a2-3a4169a07eac tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:32.784774 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-b1633c63-34ff-4269-98a2-3a4169a07eac tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:32.785632 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-b1633c63-34ff-4269-98a2-3a4169a07eac tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:32.786693 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-b1633c63-34ff-4269-98a2-3a4169a07eac tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:32.787426 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-b1633c63-34ff-4269-98a2-3a4169a07eac tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:33.109148 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-b1633c63-34ff-4269-98a2-3a4169a07eac tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:33.124221 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-b1633c63-34ff-4269-98a2-3a4169a07eac tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:33.126298 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-b1633c63-34ff-4269-98a2-3a4169a07eac tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:33.127840 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-b1633c63-34ff-4269-98a2-3a4169a07eac tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46" status: 200 len: 1740 microversion: 2.20 time: 0.386083 Jul 22 11:21:33.128724 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 424/862] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:21:32 2022] GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 => generated 1740 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:21:34.152415 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-36195a56-6980-4f86-a393-2ece197f100c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:34.153047 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-36195a56-6980-4f86-a393-2ece197f100c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:34.169576 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-36195a56-6980-4f86-a393-2ece197f100c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:34.170031 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-36195a56-6980-4f86-a393-2ece197f100c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:34.171357 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-36195a56-6980-4f86-a393-2ece197f100c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:34.180761 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-36195a56-6980-4f86-a393-2ece197f100c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:34.764465 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-36195a56-6980-4f86-a393-2ece197f100c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:34.796773 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-36195a56-6980-4f86-a393-2ece197f100c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:34.805656 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-36195a56-6980-4f86-a393-2ece197f100c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:34.809422 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-36195a56-6980-4f86-a393-2ece197f100c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46" status: 200 len: 1740 microversion: 2.20 time: 0.666686 Jul 22 11:21:34.821752 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 439/863] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:21:34 2022] GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 => generated 1740 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:21:35.461848 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-a9814516-a4e7-45c9-b58f-e7dffd4d812f tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:35.462404 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-a9814516-a4e7-45c9-b58f-e7dffd4d812f tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: edc7a08a-180f-4907-9f8d-9d14bd9cf10c] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:35.469133 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-a9814516-a4e7-45c9-b58f-e7dffd4d812f tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:35.469588 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-a9814516-a4e7-45c9-b58f-e7dffd4d812f tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:35.470450 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-a9814516-a4e7-45c9-b58f-e7dffd4d812f tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:35.470888 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-a9814516-a4e7-45c9-b58f-e7dffd4d812f tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:35.484531 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.wsgi [None req-a9814516-a4e7-45c9-b58f-e7dffd4d812f tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] HTTP exception thrown: Instance edc7a08a-180f-4907-9f8d-9d14bd9cf10c could not be found. Jul 22 11:21:35.486051 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-a9814516-a4e7-45c9-b58f-e7dffd4d812f tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Request method failure captured: Jul 22 11:21:35.486051 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: request: DELETE /compute/v2.1/servers/edc7a08a-180f-4907-9f8d-9d14bd9cf10c HTTP/1.1 Jul 22 11:21:35.486051 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Accept: application/json Jul 22 11:21:35.486051 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Accept-Encoding: identity Jul 22 11:21:35.486051 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Connection: close Jul 22 11:21:35.486051 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Content-Length: 0 Jul 22 11:21:35.486051 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Content-Type: application/json Jul 22 11:21:35.486051 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Host: 10.222.0.20 Jul 22 11:21:35.486051 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Openstack-System-Scope: None Jul 22 11:21:35.486051 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: User-Agent: python-urllib3/1.26.9 Jul 22 11:21:35.486051 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Auth-Token: gAAAAABi2oaCb6ZjdjoanfH_h9JPTqUp87mECBfq6-I-9jVCGnbw8DfIWpDq0WQ-nwPfGPDYfE40GlNjoCi25niz0gIt1tm70rKYhZ61iiEYO1DvkXJrAD9ZDO725FdcAppHCkweptc0h1Fo_PqV4DqPUPDrspxgeORVq6BMRXo9ntRdE9YcA4Y Jul 22 11:21:35.486051 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Domain-Id: None Jul 22 11:21:35.486051 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Domain-Name: None Jul 22 11:21:35.486051 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Identity-Status: Confirmed Jul 22 11:21:35.486051 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Is-Admin-Project: True Jul 22 11:21:35.486051 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Domain-Id: default Jul 22 11:21:35.486051 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Domain-Name: Default Jul 22 11:21:35.486051 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Id: f50a15db11214fb5a637fb400dcd928f Jul 22 11:21:35.486051 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Name: tempest-AttachVolumeTestJSON-127223071 Jul 22 11:21:35.486051 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Role: reader,member Jul 22 11:21:35.486051 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Roles: reader,member Jul 22 11:21:35.487478 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f50a15db11214fb5a637fb400dcd928f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f50a15db11214fb5a637fb400dcd928f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f50a15db11214fb5a637fb400dcd928f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f50a15db11214fb5a637fb400dcd928f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jul 22 11:21:35.487478 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant: tempest-AttachVolumeTestJSON-127223071 Jul 22 11:21:35.487478 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant-Id: f50a15db11214fb5a637fb400dcd928f Jul 22 11:21:35.487478 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant-Name: tempest-AttachVolumeTestJSON-127223071 Jul 22 11:21:35.487478 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User: tempest-AttachVolumeTestJSON-127223071-project Jul 22 11:21:35.487478 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Domain-Id: default Jul 22 11:21:35.487478 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Domain-Name: Default Jul 22 11:21:35.487478 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Id: da75b78b267f47e8aaaafb41e3acb61a Jul 22 11:21:35.487478 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Name: tempest-AttachVolumeTestJSON-127223071-project Jul 22 11:21:35.487478 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: method: > Jul 22 11:21:35.487478 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: exception: Instance edc7a08a-180f-4907-9f8d-9d14bd9cf10c could not be found. Jul 22 11:21:35.487478 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: action_args: {'id': 'edc7a08a-180f-4907-9f8d-9d14bd9cf10c'} Jul 22 11:21:35.488222 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 22 11:21:35.488222 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:21:35.488222 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 22 11:21:35.488222 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 22 11:21:35.488222 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 22 11:21:35.488222 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 22 11:21:35.488222 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 22 11:21:35.488222 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 22 11:21:35.488222 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 22 11:21:35.488222 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 22 11:21:35.488222 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edc7a08a-180f-4907-9f8d-9d14bd9cf10c could not be found. Jul 22 11:21:35.488222 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:21:35.488222 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:21:35.488222 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:21:35.488222 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:21:35.488222 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:21:35.488222 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:21:35.488222 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 22 11:21:35.488222 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 22 11:21:35.488222 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 22 11:21:35.489693 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 22 11:21:35.489693 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 22 11:21:35.489693 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 22 11:21:35.489693 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 22 11:21:35.489693 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 22 11:21:35.489693 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 22 11:21:35.489693 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 22 11:21:35.489693 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 22 11:21:35.489693 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 22 11:21:35.489693 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edc7a08a-180f-4907-9f8d-9d14bd9cf10c could not be found. Jul 22 11:21:35.489693 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:21:35.489693 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:21:35.489693 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:21:35.489693 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:21:35.489693 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:21:35.489693 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:21:35.489693 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 22 11:21:35.489693 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 22 11:21:35.489693 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edc7a08a-180f-4907-9f8d-9d14bd9cf10c could not be found. Jul 22 11:21:35.489693 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:21:35.490907 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-a9814516-a4e7-45c9-b58f-e7dffd4d812f tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Returning 404 to user: Instance edc7a08a-180f-4907-9f8d-9d14bd9cf10c could not be found. {{(pid=117884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 22 11:21:35.490907 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-a9814516-a4e7-45c9-b58f-e7dffd4d812f tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "DELETE /compute/v2.1/servers/edc7a08a-180f-4907-9f8d-9d14bd9cf10c" status: 404 len: 111 microversion: 2.1 time: 0.030310 Jul 22 11:21:35.490907 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 425/864] 10.222.0.20 () {58 vars in 1238 bytes} [Fri Jul 22 11:21:35 2022] DELETE /compute/v2.1/servers/edc7a08a-180f-4907-9f8d-9d14bd9cf10c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 22 11:21:35.496263 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-47208483-821f-4118-9a97-67ca7a6efa6b tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:35.496884 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-47208483-821f-4118-9a97-67ca7a6efa6b tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: edc7a08a-180f-4907-9f8d-9d14bd9cf10c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:35.504005 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-47208483-821f-4118-9a97-67ca7a6efa6b tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:35.504456 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-47208483-821f-4118-9a97-67ca7a6efa6b tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:35.505231 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-47208483-821f-4118-9a97-67ca7a6efa6b tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:35.505849 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-47208483-821f-4118-9a97-67ca7a6efa6b tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:35.520514 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.wsgi [None req-47208483-821f-4118-9a97-67ca7a6efa6b tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] HTTP exception thrown: Instance edc7a08a-180f-4907-9f8d-9d14bd9cf10c could not be found. Jul 22 11:21:35.522076 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-47208483-821f-4118-9a97-67ca7a6efa6b tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Request method failure captured: Jul 22 11:21:35.522076 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: request: GET /compute/v2.1/servers/edc7a08a-180f-4907-9f8d-9d14bd9cf10c HTTP/1.1 Jul 22 11:21:35.522076 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Accept: application/json Jul 22 11:21:35.522076 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Accept-Encoding: identity Jul 22 11:21:35.522076 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Connection: close Jul 22 11:21:35.522076 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Content-Length: 0 Jul 22 11:21:35.522076 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Content-Type: application/json Jul 22 11:21:35.522076 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Host: 10.222.0.20 Jul 22 11:21:35.522076 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Openstack-System-Scope: None Jul 22 11:21:35.522076 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: User-Agent: python-urllib3/1.26.9 Jul 22 11:21:35.522076 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Auth-Token: gAAAAABi2oaCb6ZjdjoanfH_h9JPTqUp87mECBfq6-I-9jVCGnbw8DfIWpDq0WQ-nwPfGPDYfE40GlNjoCi25niz0gIt1tm70rKYhZ61iiEYO1DvkXJrAD9ZDO725FdcAppHCkweptc0h1Fo_PqV4DqPUPDrspxgeORVq6BMRXo9ntRdE9YcA4Y Jul 22 11:21:35.522076 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Domain-Id: None Jul 22 11:21:35.522076 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Domain-Name: None Jul 22 11:21:35.522076 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Identity-Status: Confirmed Jul 22 11:21:35.522076 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Is-Admin-Project: True Jul 22 11:21:35.522076 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Project-Domain-Id: default Jul 22 11:21:35.522076 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Project-Domain-Name: Default Jul 22 11:21:35.522076 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Project-Id: f50a15db11214fb5a637fb400dcd928f Jul 22 11:21:35.522076 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Project-Name: tempest-AttachVolumeTestJSON-127223071 Jul 22 11:21:35.522076 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Role: reader,member Jul 22 11:21:35.522076 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Roles: reader,member Jul 22 11:21:35.523522 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f50a15db11214fb5a637fb400dcd928f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f50a15db11214fb5a637fb400dcd928f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f50a15db11214fb5a637fb400dcd928f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f50a15db11214fb5a637fb400dcd928f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jul 22 11:21:35.523522 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Tenant: tempest-AttachVolumeTestJSON-127223071 Jul 22 11:21:35.523522 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Tenant-Id: f50a15db11214fb5a637fb400dcd928f Jul 22 11:21:35.523522 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Tenant-Name: tempest-AttachVolumeTestJSON-127223071 Jul 22 11:21:35.523522 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User: tempest-AttachVolumeTestJSON-127223071-project Jul 22 11:21:35.523522 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User-Domain-Id: default Jul 22 11:21:35.523522 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User-Domain-Name: Default Jul 22 11:21:35.523522 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User-Id: da75b78b267f47e8aaaafb41e3acb61a Jul 22 11:21:35.523522 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User-Name: tempest-AttachVolumeTestJSON-127223071-project Jul 22 11:21:35.523522 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: method: > Jul 22 11:21:35.523522 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: exception: Instance edc7a08a-180f-4907-9f8d-9d14bd9cf10c could not be found. Jul 22 11:21:35.523522 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: action_args: {'id': 'edc7a08a-180f-4907-9f8d-9d14bd9cf10c'} Jul 22 11:21:35.527887 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 22 11:21:35.527887 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:21:35.527887 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 22 11:21:35.527887 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 22 11:21:35.527887 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 22 11:21:35.527887 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 22 11:21:35.527887 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 22 11:21:35.527887 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 22 11:21:35.527887 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 22 11:21:35.527887 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 22 11:21:35.527887 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edc7a08a-180f-4907-9f8d-9d14bd9cf10c could not be found. Jul 22 11:21:35.527887 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:21:35.527887 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:21:35.527887 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:21:35.527887 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:21:35.527887 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:21:35.527887 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:21:35.527887 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 22 11:21:35.527887 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 22 11:21:35.527887 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 22 11:21:35.529181 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 22 11:21:35.529181 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 22 11:21:35.529181 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 22 11:21:35.529181 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 22 11:21:35.529181 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 22 11:21:35.529181 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 22 11:21:35.529181 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 22 11:21:35.529181 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edc7a08a-180f-4907-9f8d-9d14bd9cf10c could not be found. Jul 22 11:21:35.529181 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:21:35.529181 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:21:35.529181 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:21:35.529181 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:21:35.529181 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:21:35.529181 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:21:35.529181 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 22 11:21:35.529181 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 22 11:21:35.529181 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edc7a08a-180f-4907-9f8d-9d14bd9cf10c could not be found. Jul 22 11:21:35.529181 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:21:35.530419 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-47208483-821f-4118-9a97-67ca7a6efa6b tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Returning 404 to user: Instance edc7a08a-180f-4907-9f8d-9d14bd9cf10c could not be found. {{(pid=117885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 22 11:21:35.530419 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-47208483-821f-4118-9a97-67ca7a6efa6b tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/edc7a08a-180f-4907-9f8d-9d14bd9cf10c" status: 404 len: 111 microversion: 2.1 time: 0.031105 Jul 22 11:21:35.530419 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 440/865] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:21:35 2022] GET /compute/v2.1/servers/edc7a08a-180f-4907-9f8d-9d14bd9cf10c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 22 11:21:35.830780 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-b208cb11-89ba-4a2e-89c1-90c082481d65 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:35.832549 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-b208cb11-89ba-4a2e-89c1-90c082481d65 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:35.843034 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-b208cb11-89ba-4a2e-89c1-90c082481d65 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:35.843487 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-b208cb11-89ba-4a2e-89c1-90c082481d65 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:35.844241 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-b208cb11-89ba-4a2e-89c1-90c082481d65 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:35.844675 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-b208cb11-89ba-4a2e-89c1-90c082481d65 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:36.100862 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-b208cb11-89ba-4a2e-89c1-90c082481d65 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:36.120440 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-b208cb11-89ba-4a2e-89c1-90c082481d65 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:36.122417 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-b208cb11-89ba-4a2e-89c1-90c082481d65 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:36.124774 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-b208cb11-89ba-4a2e-89c1-90c082481d65 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46" status: 200 len: 1722 microversion: 2.20 time: 0.298421 Jul 22 11:21:36.126062 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 426/866] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:21:35 2022] GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 => generated 1722 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:21:36.721787 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-7cf4f7db-e4aa-46bf-9b13-d5e794d33b26 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:36.722517 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-7cf4f7db-e4aa-46bf-9b13-d5e794d33b26 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:36.732948 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7cf4f7db-e4aa-46bf-9b13-d5e794d33b26 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:36.732948 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7cf4f7db-e4aa-46bf-9b13-d5e794d33b26 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:36.733351 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7cf4f7db-e4aa-46bf-9b13-d5e794d33b26 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:36.733784 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7cf4f7db-e4aa-46bf-9b13-d5e794d33b26 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:36.751229 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.wsgi [None req-7cf4f7db-e4aa-46bf-9b13-d5e794d33b26 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] HTTP exception thrown: Instance 1cafe061-7a16-4c2c-8796-da7dac3f27f1 could not be found. Jul 22 11:21:36.753390 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-7cf4f7db-e4aa-46bf-9b13-d5e794d33b26 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Request method failure captured: Jul 22 11:21:36.753390 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: request: DELETE /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 HTTP/1.1 Jul 22 11:21:36.753390 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Accept: application/json Jul 22 11:21:36.753390 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Accept-Encoding: identity Jul 22 11:21:36.753390 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Connection: close Jul 22 11:21:36.753390 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Content-Length: 0 Jul 22 11:21:36.753390 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Content-Type: application/json Jul 22 11:21:36.753390 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Host: 10.222.0.20 Jul 22 11:21:36.753390 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Openstack-System-Scope: None Jul 22 11:21:36.753390 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: User-Agent: python-urllib3/1.26.9 Jul 22 11:21:36.753390 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Auth-Token: gAAAAABi2oaCb6ZjdjoanfH_h9JPTqUp87mECBfq6-I-9jVCGnbw8DfIWpDq0WQ-nwPfGPDYfE40GlNjoCi25niz0gIt1tm70rKYhZ61iiEYO1DvkXJrAD9ZDO725FdcAppHCkweptc0h1Fo_PqV4DqPUPDrspxgeORVq6BMRXo9ntRdE9YcA4Y Jul 22 11:21:36.753390 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Domain-Id: None Jul 22 11:21:36.753390 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Domain-Name: None Jul 22 11:21:36.753390 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Identity-Status: Confirmed Jul 22 11:21:36.753390 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Is-Admin-Project: True Jul 22 11:21:36.753390 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Project-Domain-Id: default Jul 22 11:21:36.753390 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Project-Domain-Name: Default Jul 22 11:21:36.753390 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Project-Id: f50a15db11214fb5a637fb400dcd928f Jul 22 11:21:36.753390 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Project-Name: tempest-AttachVolumeTestJSON-127223071 Jul 22 11:21:36.753390 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Role: reader,member Jul 22 11:21:36.753390 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Roles: reader,member Jul 22 11:21:36.760390 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f50a15db11214fb5a637fb400dcd928f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f50a15db11214fb5a637fb400dcd928f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f50a15db11214fb5a637fb400dcd928f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f50a15db11214fb5a637fb400dcd928f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jul 22 11:21:36.760390 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Tenant: tempest-AttachVolumeTestJSON-127223071 Jul 22 11:21:36.760390 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Tenant-Id: f50a15db11214fb5a637fb400dcd928f Jul 22 11:21:36.760390 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Tenant-Name: tempest-AttachVolumeTestJSON-127223071 Jul 22 11:21:36.760390 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User: tempest-AttachVolumeTestJSON-127223071-project Jul 22 11:21:36.760390 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User-Domain-Id: default Jul 22 11:21:36.760390 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User-Domain-Name: Default Jul 22 11:21:36.760390 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User-Id: da75b78b267f47e8aaaafb41e3acb61a Jul 22 11:21:36.760390 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User-Name: tempest-AttachVolumeTestJSON-127223071-project Jul 22 11:21:36.760390 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: method: > Jul 22 11:21:36.760390 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: exception: Instance 1cafe061-7a16-4c2c-8796-da7dac3f27f1 could not be found. Jul 22 11:21:36.760390 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: action_args: {'id': '1cafe061-7a16-4c2c-8796-da7dac3f27f1'} Jul 22 11:21:36.761939 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 22 11:21:36.761939 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:21:36.761939 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 22 11:21:36.761939 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 22 11:21:36.761939 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 22 11:21:36.761939 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 22 11:21:36.761939 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 22 11:21:36.761939 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 22 11:21:36.761939 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 22 11:21:36.761939 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 22 11:21:36.761939 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cafe061-7a16-4c2c-8796-da7dac3f27f1 could not be found. Jul 22 11:21:36.761939 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:21:36.761939 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:21:36.761939 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:21:36.761939 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:21:36.761939 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:21:36.761939 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:21:36.761939 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 22 11:21:36.761939 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 22 11:21:36.761939 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 22 11:21:36.765730 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 22 11:21:36.765730 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 22 11:21:36.765730 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 22 11:21:36.765730 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 22 11:21:36.765730 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 22 11:21:36.765730 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 22 11:21:36.765730 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 22 11:21:36.765730 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 22 11:21:36.765730 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 22 11:21:36.765730 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cafe061-7a16-4c2c-8796-da7dac3f27f1 could not be found. Jul 22 11:21:36.765730 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:21:36.765730 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:21:36.765730 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:21:36.765730 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:21:36.765730 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:21:36.765730 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:21:36.765730 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 22 11:21:36.765730 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 22 11:21:36.765730 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cafe061-7a16-4c2c-8796-da7dac3f27f1 could not be found. Jul 22 11:21:36.765730 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:21:36.769350 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-7cf4f7db-e4aa-46bf-9b13-d5e794d33b26 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Returning 404 to user: Instance 1cafe061-7a16-4c2c-8796-da7dac3f27f1 could not be found. {{(pid=117885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 22 11:21:36.769350 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-7cf4f7db-e4aa-46bf-9b13-d5e794d33b26 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 404 len: 111 microversion: 2.1 time: 0.036938 Jul 22 11:21:36.769350 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 441/867] 10.222.0.20 () {58 vars in 1238 bytes} [Fri Jul 22 11:21:36 2022] DELETE /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 22 11:21:36.770553 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-0f757054-63b1-4b58-824e-e2e4149ca462 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:36.771662 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-0f757054-63b1-4b58-824e-e2e4149ca462 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] [instance: 1cafe061-7a16-4c2c-8796-da7dac3f27f1] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:36.782015 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-0f757054-63b1-4b58-824e-e2e4149ca462 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:36.782791 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-0f757054-63b1-4b58-824e-e2e4149ca462 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:36.784064 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-0f757054-63b1-4b58-824e-e2e4149ca462 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:36.784778 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-0f757054-63b1-4b58-824e-e2e4149ca462 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:36.808404 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.wsgi [None req-0f757054-63b1-4b58-824e-e2e4149ca462 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] HTTP exception thrown: Instance 1cafe061-7a16-4c2c-8796-da7dac3f27f1 could not be found. Jul 22 11:21:36.811298 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-0f757054-63b1-4b58-824e-e2e4149ca462 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Request method failure captured: Jul 22 11:21:36.811298 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: request: GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 HTTP/1.1 Jul 22 11:21:36.811298 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Accept: application/json Jul 22 11:21:36.811298 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Accept-Encoding: identity Jul 22 11:21:36.811298 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Connection: close Jul 22 11:21:36.811298 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Content-Length: 0 Jul 22 11:21:36.811298 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Content-Type: application/json Jul 22 11:21:36.811298 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Host: 10.222.0.20 Jul 22 11:21:36.811298 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Openstack-System-Scope: None Jul 22 11:21:36.811298 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: User-Agent: python-urllib3/1.26.9 Jul 22 11:21:36.811298 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Auth-Token: gAAAAABi2oaCb6ZjdjoanfH_h9JPTqUp87mECBfq6-I-9jVCGnbw8DfIWpDq0WQ-nwPfGPDYfE40GlNjoCi25niz0gIt1tm70rKYhZ61iiEYO1DvkXJrAD9ZDO725FdcAppHCkweptc0h1Fo_PqV4DqPUPDrspxgeORVq6BMRXo9ntRdE9YcA4Y Jul 22 11:21:36.811298 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Domain-Id: None Jul 22 11:21:36.811298 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Domain-Name: None Jul 22 11:21:36.811298 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Identity-Status: Confirmed Jul 22 11:21:36.811298 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Is-Admin-Project: True Jul 22 11:21:36.811298 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Domain-Id: default Jul 22 11:21:36.811298 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Domain-Name: Default Jul 22 11:21:36.811298 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Id: f50a15db11214fb5a637fb400dcd928f Jul 22 11:21:36.811298 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Name: tempest-AttachVolumeTestJSON-127223071 Jul 22 11:21:36.811298 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Role: reader,member Jul 22 11:21:36.811298 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Roles: reader,member Jul 22 11:21:36.812869 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f50a15db11214fb5a637fb400dcd928f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f50a15db11214fb5a637fb400dcd928f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f50a15db11214fb5a637fb400dcd928f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f50a15db11214fb5a637fb400dcd928f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jul 22 11:21:36.812869 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant: tempest-AttachVolumeTestJSON-127223071 Jul 22 11:21:36.812869 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant-Id: f50a15db11214fb5a637fb400dcd928f Jul 22 11:21:36.812869 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant-Name: tempest-AttachVolumeTestJSON-127223071 Jul 22 11:21:36.812869 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User: tempest-AttachVolumeTestJSON-127223071-project Jul 22 11:21:36.812869 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Domain-Id: default Jul 22 11:21:36.812869 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Domain-Name: Default Jul 22 11:21:36.812869 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Id: da75b78b267f47e8aaaafb41e3acb61a Jul 22 11:21:36.812869 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Name: tempest-AttachVolumeTestJSON-127223071-project Jul 22 11:21:36.812869 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: method: > Jul 22 11:21:36.812869 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: exception: Instance 1cafe061-7a16-4c2c-8796-da7dac3f27f1 could not be found. Jul 22 11:21:36.812869 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: action_args: {'id': '1cafe061-7a16-4c2c-8796-da7dac3f27f1'} Jul 22 11:21:36.813726 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 22 11:21:36.813726 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:21:36.813726 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 22 11:21:36.813726 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 22 11:21:36.813726 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 22 11:21:36.813726 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 22 11:21:36.813726 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 22 11:21:36.813726 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 22 11:21:36.813726 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 22 11:21:36.813726 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 22 11:21:36.813726 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cafe061-7a16-4c2c-8796-da7dac3f27f1 could not be found. Jul 22 11:21:36.813726 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:21:36.813726 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:21:36.813726 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:21:36.813726 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:21:36.813726 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:21:36.813726 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:21:36.813726 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 22 11:21:36.813726 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 22 11:21:36.813726 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 22 11:21:36.815502 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 22 11:21:36.815502 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 22 11:21:36.815502 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 22 11:21:36.815502 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 22 11:21:36.815502 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 22 11:21:36.815502 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 22 11:21:36.815502 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 22 11:21:36.815502 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cafe061-7a16-4c2c-8796-da7dac3f27f1 could not be found. Jul 22 11:21:36.815502 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:21:36.815502 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:21:36.815502 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:21:36.815502 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:21:36.815502 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:21:36.815502 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:21:36.815502 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 22 11:21:36.815502 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 22 11:21:36.815502 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cafe061-7a16-4c2c-8796-da7dac3f27f1 could not be found. Jul 22 11:21:36.815502 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:21:36.817558 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-0f757054-63b1-4b58-824e-e2e4149ca462 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] Returning 404 to user: Instance 1cafe061-7a16-4c2c-8796-da7dac3f27f1 could not be found. {{(pid=117884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 22 11:21:36.817558 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-0f757054-63b1-4b58-824e-e2e4149ca462 tempest-AttachVolumeTestJSON-127223071 tempest-AttachVolumeTestJSON-127223071-project] 10.222.0.20 "GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1" status: 404 len: 111 microversion: 2.1 time: 0.052500 Jul 22 11:21:36.817558 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 427/868] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:21:36 2022] GET /compute/v2.1/servers/1cafe061-7a16-4c2c-8796-da7dac3f27f1 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 22 11:21:37.146261 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-06310fd7-40ad-4d20-a19f-c962baf7c2ec tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:37.147199 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-06310fd7-40ad-4d20-a19f-c962baf7c2ec tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:37.155775 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-06310fd7-40ad-4d20-a19f-c962baf7c2ec tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:37.155775 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-06310fd7-40ad-4d20-a19f-c962baf7c2ec tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:37.156280 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-06310fd7-40ad-4d20-a19f-c962baf7c2ec tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:37.157110 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-06310fd7-40ad-4d20-a19f-c962baf7c2ec tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:37.392504 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-06310fd7-40ad-4d20-a19f-c962baf7c2ec tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:37.404954 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-06310fd7-40ad-4d20-a19f-c962baf7c2ec tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:37.407431 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-06310fd7-40ad-4d20-a19f-c962baf7c2ec tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:37.408531 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-06310fd7-40ad-4d20-a19f-c962baf7c2ec tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46" status: 200 len: 1722 microversion: 2.20 time: 0.266999 Jul 22 11:21:37.409089 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 442/869] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:21:37 2022] GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 => generated 1722 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:21:37.624060 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-942c1677-7c23-4b7b-8d4c-fda4da9d01bb tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2121363553", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-600883544", "security_groups": [{"name": "tempest-secgroup-smoke-1266173586"}], "block_device_mapping_v2": [{"uuid": "33823faa-9a64-4741-a6cf-16e8dae4c838", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "050b1084-bd00-4a10-81b9-1276e2d9b4d8"}]}} {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:21:37.761869 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.network.neutron [None req-942c1677-7c23-4b7b-8d4c-fda4da9d01bb tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] validate_networks() for [('050b1084-bd00-4a10-81b9-1276e2d9b4d8', None, None, None, None, None)] {{(pid=117884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 22 11:21:37.814224 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-6bb63bcc-ef81-45d9-95a5-09be133fa810 tempest-VolumesGetTestJSON-1332505811 tempest-VolumesGetTestJSON-1332505811-project] Action: 'create', calling method: .version_select at 0x7f84451b8940>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-372022835", "metadata": {"Type": "work"}}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:21:38.222251 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.virt.hardware [None req-942c1677-7c23-4b7b-8d4c-fda4da9d01bb tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Flavor limits 0:0:0 {{(pid=117884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 22 11:21:38.222787 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.virt.hardware [None req-942c1677-7c23-4b7b-8d4c-fda4da9d01bb tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Image limits 0:0:0 {{(pid=117884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 22 11:21:38.223503 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.virt.hardware [None req-942c1677-7c23-4b7b-8d4c-fda4da9d01bb tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Flavor pref 0:0:0 {{(pid=117884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 22 11:21:38.223880 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.virt.hardware [None req-942c1677-7c23-4b7b-8d4c-fda4da9d01bb tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Image pref 0:0:0 {{(pid=117884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 22 11:21:38.224490 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.virt.hardware [None req-942c1677-7c23-4b7b-8d4c-fda4da9d01bb tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 22 11:21:38.254321 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-942c1677-7c23-4b7b-8d4c-fda4da9d01bb tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:38.258249 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-942c1677-7c23-4b7b-8d4c-fda4da9d01bb tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:38.259630 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-942c1677-7c23-4b7b-8d4c-fda4da9d01bb tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:38.260513 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-942c1677-7c23-4b7b-8d4c-fda4da9d01bb tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:38.293806 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-6bb63bcc-ef81-45d9-95a5-09be133fa810 tempest-VolumesGetTestJSON-1332505811 tempest-VolumesGetTestJSON-1332505811-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.628841 Jul 22 11:21:38.300607 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 443/870] 10.222.0.20 () {60 vars in 1155 bytes} [Fri Jul 22 11:21:37 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 630 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jul 22 11:21:38.300607 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-67deb179-9ff0-44cf-aa52-d111f9465488 req-bee70ffd-a6e8-40af-a120-ddd62c493c99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46", "name": "network-vif-unplugged", "status": "completed", "tag": "c1ac6e13-743e-4cd7-b970-2f05998ba958"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:21:38.319596 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.quota [None req-942c1677-7c23-4b7b-8d4c-fda4da9d01bb tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Getting quotas for project 04d58bceb8414b02a1bbaec0db07d85e. Resources: {'instances', 'cores', 'ram'} {{(pid=117884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 22 11:21:38.327227 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-67deb179-9ff0-44cf-aa52-d111f9465488 req-bee70ffd-a6e8-40af-a120-ddd62c493c99 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:38.328105 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-67deb179-9ff0-44cf-aa52-d111f9465488 req-bee70ffd-a6e8-40af-a120-ddd62c493c99 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:38.336331 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.quota [None req-942c1677-7c23-4b7b-8d4c-fda4da9d01bb tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Getting quotas for user 1a299663b56b411b9fc910ddf47103e5 and project 04d58bceb8414b02a1bbaec0db07d85e. Resources: {'instances', 'cores', 'ram'} {{(pid=117884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 22 11:21:38.354739 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-67deb179-9ff0-44cf-aa52-d111f9465488 req-bee70ffd-a6e8-40af-a120-ddd62c493c99 service nova] Creating event network-vif-unplugged:c1ac6e13-743e-4cd7-b970-2f05998ba958 for instance f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 on hv-cinder-84890 Jul 22 11:21:38.366020 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-67deb179-9ff0-44cf-aa52-d111f9465488 req-bee70ffd-a6e8-40af-a120-ddd62c493c99 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067121 Jul 22 11:21:38.367752 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 444/871] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:21:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:21:38.379561 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-86cd7da0-9177-4010-a575-9b3e86c5f752 tempest-VolumesGetTestJSON-1332505811 tempest-VolumesGetTestJSON-1332505811-project] Calling method '.version_select at 0x7f84499acb80>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:38.435089 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-86cd7da0-9177-4010-a575-9b3e86c5f752 tempest-VolumesGetTestJSON-1332505811 tempest-VolumesGetTestJSON-1332505811-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/94b78a51-6168-4baf-86e4-136740c227f1" status: 200 len: 352 microversion: 2.1 time: 0.061981 Jul 22 11:21:38.436331 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 445/872] 10.222.0.20 () {58 vars in 1244 bytes} [Fri Jul 22 11:21:38 2022] GET /compute/v2.1/os-volumes/94b78a51-6168-4baf-86e4-136740c227f1 => generated 352 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:21:38.446340 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-c15c8cf9-7822-4d3c-a047-60dac773c4cd tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:38.447164 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-c15c8cf9-7822-4d3c-a047-60dac773c4cd tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:38.451622 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-942c1677-7c23-4b7b-8d4c-fda4da9d01bb tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Going to run 1 instances... {{(pid=117884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 22 11:21:38.453704 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-942c1677-7c23-4b7b-8d4c-fda4da9d01bb tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] [instance: 36dec2db-4166-4853-a79b-832ad7fc2730] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='33823faa-9a64-4741-a6cf-16e8dae4c838',volume_size=None,volume_type=None)] {{(pid=117884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 22 11:21:38.462929 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c15c8cf9-7822-4d3c-a047-60dac773c4cd tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:38.463273 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c15c8cf9-7822-4d3c-a047-60dac773c4cd tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:38.470236 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c15c8cf9-7822-4d3c-a047-60dac773c4cd tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:38.470977 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c15c8cf9-7822-4d3c-a047-60dac773c4cd tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:38.637705 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-942c1677-7c23-4b7b-8d4c-fda4da9d01bb tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.019541 Jul 22 11:21:38.644570 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 428/873] 10.222.0.20 () {60 vars in 1146 bytes} [Fri Jul 22 11:21:37 2022] POST /compute/v2.1/servers => generated 406 bytes in 1027 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 22 11:21:38.650044 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-9f52d360-3851-45db-bb1c-ca5d7a1cac2b tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:38.650673 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-9f52d360-3851-45db-bb1c-ca5d7a1cac2b tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] [instance: 36dec2db-4166-4853-a79b-832ad7fc2730] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:38.714363 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-9f52d360-3851-45db-bb1c-ca5d7a1cac2b tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a299663b56b411b9fc910ddf47103e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d58bceb8414b02a1bbaec0db07d85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:38.721925 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-9f52d360-3851-45db-bb1c-ca5d7a1cac2b tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] 10.222.0.20 "GET /compute/v2.1/servers/36dec2db-4166-4853-a79b-832ad7fc2730" status: 200 len: 1094 microversion: 2.1 time: 0.076100 Jul 22 11:21:38.722502 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 429/874] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:21:38 2022] GET /compute/v2.1/servers/36dec2db-4166-4853-a79b-832ad7fc2730 => generated 1094 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:21:38.727580 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-c15c8cf9-7822-4d3c-a047-60dac773c4cd tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:38.740702 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-c15c8cf9-7822-4d3c-a047-60dac773c4cd tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:38.742327 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-c15c8cf9-7822-4d3c-a047-60dac773c4cd tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:38.744622 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-c15c8cf9-7822-4d3c-a047-60dac773c4cd tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46" status: 200 len: 1722 microversion: 2.20 time: 0.302534 Jul 22 11:21:38.745291 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 446/875] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:21:38 2022] GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 => generated 1722 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:21:39.451480 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-e563b65d-7895-4b6c-9428-8cb91e90bb42 tempest-VolumesGetTestJSON-1332505811 tempest-VolumesGetTestJSON-1332505811-project] Calling method '.version_select at 0x7f844505af70>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:39.512527 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-e563b65d-7895-4b6c-9428-8cb91e90bb42 tempest-VolumesGetTestJSON-1332505811 tempest-VolumesGetTestJSON-1332505811-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/94b78a51-6168-4baf-86e4-136740c227f1" status: 200 len: 353 microversion: 2.1 time: 0.065295 Jul 22 11:21:39.521462 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 430/876] 10.222.0.20 () {58 vars in 1244 bytes} [Fri Jul 22 11:21:39 2022] GET /compute/v2.1/os-volumes/94b78a51-6168-4baf-86e4-136740c227f1 => generated 353 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:21:39.534760 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-b2c4cc10-5287-4b74-96c0-c6ad34f88b72 tempest-VolumesGetTestJSON-1332505811 tempest-VolumesGetTestJSON-1332505811-project] Calling method '.version_select at 0x7f8449a29a60>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:39.590239 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-b2c4cc10-5287-4b74-96c0-c6ad34f88b72 tempest-VolumesGetTestJSON-1332505811 tempest-VolumesGetTestJSON-1332505811-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/94b78a51-6168-4baf-86e4-136740c227f1" status: 200 len: 353 microversion: 2.1 time: 0.060220 Jul 22 11:21:39.590819 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 447/877] 10.222.0.20 () {58 vars in 1244 bytes} [Fri Jul 22 11:21:39 2022] GET /compute/v2.1/os-volumes/94b78a51-6168-4baf-86e4-136740c227f1 => generated 353 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:21:39.609207 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-24199164-06f8-4bd2-a3cb-78643058781c tempest-VolumesGetTestJSON-1332505811 tempest-VolumesGetTestJSON-1332505811-project] Calling method '.version_select at 0x7f8444fa3430>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:39.681356 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-24199164-06f8-4bd2-a3cb-78643058781c tempest-VolumesGetTestJSON-1332505811 tempest-VolumesGetTestJSON-1332505811-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/94b78a51-6168-4baf-86e4-136740c227f1" status: 202 len: 0 microversion: 2.1 time: 0.075858 Jul 22 11:21:39.682162 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 431/878] 10.222.0.20 () {58 vars in 1247 bytes} [Fri Jul 22 11:21:39 2022] DELETE /compute/v2.1/os-volumes/94b78a51-6168-4baf-86e4-136740c227f1 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 22 11:21:39.691949 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-ad14da81-e4dc-4b5a-bdf4-f1bfb62b5ab0 tempest-VolumesGetTestJSON-1332505811 tempest-VolumesGetTestJSON-1332505811-project] Calling method '.version_select at 0x7f84451569d0>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:39.744067 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-b0d02ad0-51f8-4edf-ad97-bd03318504db tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:39.745303 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-b0d02ad0-51f8-4edf-ad97-bd03318504db tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] [instance: 36dec2db-4166-4853-a79b-832ad7fc2730] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:39.753051 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-b0d02ad0-51f8-4edf-ad97-bd03318504db tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:39.753803 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-b0d02ad0-51f8-4edf-ad97-bd03318504db tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:39.754825 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-b0d02ad0-51f8-4edf-ad97-bd03318504db tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:39.755480 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-b0d02ad0-51f8-4edf-ad97-bd03318504db tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:39.767912 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-ad14da81-e4dc-4b5a-bdf4-f1bfb62b5ab0 tempest-VolumesGetTestJSON-1332505811 tempest-VolumesGetTestJSON-1332505811-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/94b78a51-6168-4baf-86e4-136740c227f1" status: 200 len: 352 microversion: 2.1 time: 0.080618 Jul 22 11:21:39.769877 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 448/879] 10.222.0.20 () {58 vars in 1244 bytes} [Fri Jul 22 11:21:39 2022] GET /compute/v2.1/os-volumes/94b78a51-6168-4baf-86e4-136740c227f1 => generated 352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:21:39.790884 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-d5e5dac5-2c38-41b3-aa42-0cf211d41611 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:39.791540 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-d5e5dac5-2c38-41b3-aa42-0cf211d41611 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:39.801858 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d5e5dac5-2c38-41b3-aa42-0cf211d41611 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:39.803856 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d5e5dac5-2c38-41b3-aa42-0cf211d41611 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:39.805600 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d5e5dac5-2c38-41b3-aa42-0cf211d41611 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:39.806052 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d5e5dac5-2c38-41b3-aa42-0cf211d41611 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:39.908468 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-b0d02ad0-51f8-4edf-ad97-bd03318504db tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a299663b56b411b9fc910ddf47103e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d58bceb8414b02a1bbaec0db07d85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:39.921793 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-b0d02ad0-51f8-4edf-ad97-bd03318504db tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] 10.222.0.20 "GET /compute/v2.1/servers/36dec2db-4166-4853-a79b-832ad7fc2730" status: 200 len: 1200 microversion: 2.1 time: 0.182612 Jul 22 11:21:39.923039 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 432/880] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:21:39 2022] GET /compute/v2.1/servers/36dec2db-4166-4853-a79b-832ad7fc2730 => generated 1200 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:21:39.981355 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-d5e5dac5-2c38-41b3-aa42-0cf211d41611 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:39.993752 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-d5e5dac5-2c38-41b3-aa42-0cf211d41611 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:39.999564 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-d5e5dac5-2c38-41b3-aa42-0cf211d41611 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:40.001153 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-d5e5dac5-2c38-41b3-aa42-0cf211d41611 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46" status: 200 len: 1665 microversion: 2.20 time: 0.228842 Jul 22 11:21:40.008618 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 449/881] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:21:39 2022] GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 => generated 1665 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:21:40.021869 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-94b7c54b-760c-4d94-8ff3-793a20f04a99 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eb3da871-f665-4033-acb2-602056e8fe48"}} {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:21:40.023003 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-94b7c54b-760c-4d94-8ff3-793a20f04a99 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:40.030121 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-94b7c54b-760c-4d94-8ff3-793a20f04a99 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:40.030121 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-94b7c54b-760c-4d94-8ff3-793a20f04a99 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:40.030862 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-94b7c54b-760c-4d94-8ff3-793a20f04a99 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:40.031514 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-94b7c54b-760c-4d94-8ff3-793a20f04a99 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:40.355428 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-94b7c54b-760c-4d94-8ff3-793a20f04a99 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "POST /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.337845 Jul 22 11:21:40.358455 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 433/882] 10.222.0.20 () {62 vars in 1363 bytes} [Fri Jul 22 11:21:40 2022] POST /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46/os-volume_attachments => generated 188 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 22 11:21:40.588178 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-551ffa4d-3417-4d6e-bd1c-55b4904be578 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:40.588712 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-551ffa4d-3417-4d6e-bd1c-55b4904be578 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:40.609194 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-551ffa4d-3417-4d6e-bd1c-55b4904be578 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:40.610298 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-551ffa4d-3417-4d6e-bd1c-55b4904be578 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:40.612281 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-551ffa4d-3417-4d6e-bd1c-55b4904be578 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:40.612854 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-551ffa4d-3417-4d6e-bd1c-55b4904be578 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:40.786644 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-f865765f-0ba6-40b3-ac42-dc62a34bbdba tempest-VolumesGetTestJSON-1332505811 tempest-VolumesGetTestJSON-1332505811-project] Calling method '.version_select at 0x7f844507ca60>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:40.844790 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.wsgi [None req-f865765f-0ba6-40b3-ac42-dc62a34bbdba tempest-VolumesGetTestJSON-1332505811 tempest-VolumesGetTestJSON-1332505811-project] HTTP exception thrown: Volume 94b78a51-6168-4baf-86e4-136740c227f1 could not be found. Jul 22 11:21:40.847706 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-f865765f-0ba6-40b3-ac42-dc62a34bbdba tempest-VolumesGetTestJSON-1332505811 tempest-VolumesGetTestJSON-1332505811-project] Request method failure captured: Jul 22 11:21:40.847706 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: request: GET /compute/v2.1/os-volumes/94b78a51-6168-4baf-86e4-136740c227f1 HTTP/1.1 Jul 22 11:21:40.847706 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Accept: application/json Jul 22 11:21:40.847706 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Accept-Encoding: identity Jul 22 11:21:40.847706 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Connection: close Jul 22 11:21:40.847706 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Content-Length: 0 Jul 22 11:21:40.847706 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Content-Type: application/json Jul 22 11:21:40.847706 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Host: 10.222.0.20 Jul 22 11:21:40.847706 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Openstack-System-Scope: None Jul 22 11:21:40.847706 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: User-Agent: python-urllib3/1.26.9 Jul 22 11:21:40.847706 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Auth-Token: gAAAAABi2ohBM0YYmKrJK32yQC07iGI2_dL8-tZJmWKzj4BbBG4ZSdeseTq6ErPmnPRa78XE1Tx-XZAk50NsZaBo7W3YmJRrspHoPEShfwAsd-8T9I9ijlLVq3jcoV8VxwIZNr7dReWsMUh_rPw6LAVb5jr5LlUhhaWTtcY7Fa8IYHrMQSumUHE Jul 22 11:21:40.847706 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Domain-Id: None Jul 22 11:21:40.847706 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Domain-Name: None Jul 22 11:21:40.847706 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Identity-Status: Confirmed Jul 22 11:21:40.847706 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Is-Admin-Project: True Jul 22 11:21:40.847706 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Domain-Id: default Jul 22 11:21:40.847706 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Domain-Name: Default Jul 22 11:21:40.847706 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Id: 07a139ca32b644f9af419289061346dc Jul 22 11:21:40.847706 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Name: tempest-VolumesGetTestJSON-1332505811 Jul 22 11:21:40.847706 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Role: reader,member Jul 22 11:21:40.847706 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Roles: reader,member Jul 22 11:21:40.849291 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/07a139ca32b644f9af419289061346dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_07a139ca32b644f9af419289061346dc", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/07a139ca32b644f9af419289061346dc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/07a139ca32b644f9af419289061346dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jul 22 11:21:40.849291 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant: tempest-VolumesGetTestJSON-1332505811 Jul 22 11:21:40.849291 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant-Id: 07a139ca32b644f9af419289061346dc Jul 22 11:21:40.849291 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant-Name: tempest-VolumesGetTestJSON-1332505811 Jul 22 11:21:40.849291 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User: tempest-VolumesGetTestJSON-1332505811-project Jul 22 11:21:40.849291 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Domain-Id: default Jul 22 11:21:40.849291 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Domain-Name: Default Jul 22 11:21:40.849291 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Id: be8df4382111426980dcdf8239e49ecc Jul 22 11:21:40.849291 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Name: tempest-VolumesGetTestJSON-1332505811-project Jul 22 11:21:40.849291 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: method: Jul 22 11:21:40.849291 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: exception: Volume 94b78a51-6168-4baf-86e4-136740c227f1 could not be found. Jul 22 11:21:40.849291 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: action_args: {'id': '94b78a51-6168-4baf-86e4-136740c227f1'} Jul 22 11:21:40.849291 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 22 11:21:40.853257 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:21:40.853257 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 22 11:21:40.853257 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 22 11:21:40.853257 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 22 11:21:40.853257 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 22 11:21:40.853257 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 22 11:21:40.853257 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 22 11:21:40.853257 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 22 11:21:40.853257 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 22 11:21:40.853257 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 22 11:21:40.853257 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 22 11:21:40.853257 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 22 11:21:40.853257 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 22 11:21:40.853257 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 22 11:21:40.853257 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 22 11:21:40.853257 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 94b78a51-6168-4baf-86e4-136740c227f1 could not be found. (HTTP 404) (Request-ID: req-bfb6c50e-f3dc-4ef5-ade5-bc979540dfb3) Jul 22 11:21:40.853257 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:21:40.853257 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:21:40.853257 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:21:40.854619 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:21:40.854619 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 22 11:21:40.854619 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 22 11:21:40.854619 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 22 11:21:40.854619 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 22 11:21:40.854619 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 22 11:21:40.854619 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 22 11:21:40.854619 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 22 11:21:40.854619 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 22 11:21:40.854619 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 22 11:21:40.854619 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 22 11:21:40.854619 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 22 11:21:40.854619 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 22 11:21:40.854619 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 22 11:21:40.854619 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 22 11:21:40.854619 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 22 11:21:40.854619 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 22 11:21:40.854619 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 22 11:21:40.854619 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 22 11:21:40.856749 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 22 11:21:40.856749 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 22 11:21:40.856749 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 22 11:21:40.856749 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 22 11:21:40.856749 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 94b78a51-6168-4baf-86e4-136740c227f1 could not be found. Jul 22 11:21:40.856749 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:21:40.856749 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:21:40.856749 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:21:40.856749 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:21:40.856749 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:21:40.856749 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:21:40.856749 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 22 11:21:40.856749 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 22 11:21:40.856749 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 22 11:21:40.856749 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 22 11:21:40.856749 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 22 11:21:40.856749 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 22 11:21:40.856749 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 22 11:21:40.856749 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 22 11:21:40.858062 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 94b78a51-6168-4baf-86e4-136740c227f1 could not be found. Jul 22 11:21:40.858062 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:21:40.858062 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:21:40.858062 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:21:40.858062 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:21:40.858062 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:21:40.858062 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:21:40.858062 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 22 11:21:40.858062 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 22 11:21:40.858062 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 94b78a51-6168-4baf-86e4-136740c227f1 could not be found. Jul 22 11:21:40.858062 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:21:40.858062 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-f865765f-0ba6-40b3-ac42-dc62a34bbdba tempest-VolumesGetTestJSON-1332505811 tempest-VolumesGetTestJSON-1332505811-project] Returning 404 to user: Volume 94b78a51-6168-4baf-86e4-136740c227f1 could not be found. {{(pid=117884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 22 11:21:40.858062 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-f865765f-0ba6-40b3-ac42-dc62a34bbdba tempest-VolumesGetTestJSON-1332505811 tempest-VolumesGetTestJSON-1332505811-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/94b78a51-6168-4baf-86e4-136740c227f1" status: 404 len: 109 microversion: 2.1 time: 0.070831 Jul 22 11:21:40.858062 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 434/883] 10.222.0.20 () {58 vars in 1244 bytes} [Fri Jul 22 11:21:40 2022] GET /compute/v2.1/os-volumes/94b78a51-6168-4baf-86e4-136740c227f1 => generated 109 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 22 11:21:40.942550 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-db5b0927-3ac5-4d81-a603-3534c2b65302 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:40.943374 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-db5b0927-3ac5-4d81-a603-3534c2b65302 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] [instance: 36dec2db-4166-4853-a79b-832ad7fc2730] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:40.952475 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-db5b0927-3ac5-4d81-a603-3534c2b65302 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:40.952933 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-db5b0927-3ac5-4d81-a603-3534c2b65302 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:40.958888 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-db5b0927-3ac5-4d81-a603-3534c2b65302 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:40.959412 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-db5b0927-3ac5-4d81-a603-3534c2b65302 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:41.028558 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:21:41.080478 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-551ffa4d-3417-4d6e-bd1c-55b4904be578 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46/os-volume_attachments/eb3da871-f665-4033-acb2-602056e8fe48" status: 202 len: 0 microversion: 2.20 time: 0.496402 Jul 22 11:21:41.081957 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 450/884] 10.222.0.20 () {60 vars in 1456 bytes} [Fri Jul 22 11:21:40 2022] DELETE /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46/os-volume_attachments/eb3da871-f665-4033-acb2-602056e8fe48 => generated 0 bytes in 499 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 22 11:21:41.184083 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-44aadbd7-4cbc-480e-930e-b274fc119300 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:21:41.184661 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-44aadbd7-4cbc-480e-930e-b274fc119300 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:41.195887 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-44aadbd7-4cbc-480e-930e-b274fc119300 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:41.196981 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-44aadbd7-4cbc-480e-930e-b274fc119300 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:41.198658 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-44aadbd7-4cbc-480e-930e-b274fc119300 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:41.200279 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-44aadbd7-4cbc-480e-930e-b274fc119300 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:41.382587 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-44aadbd7-4cbc-480e-930e-b274fc119300 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "POST /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46/action" status: 202 len: 0 microversion: 2.20 time: 0.201892 Jul 22 11:21:41.383224 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 451/885] 10.222.0.20 () {62 vars in 1318 bytes} [Fri Jul 22 11:21:41 2022] POST /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46/action => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 22 11:21:41.394934 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-7668e90e-3636-48ba-a4a1-b3575bbc968d tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:41.395583 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-7668e90e-3636-48ba-a4a1-b3575bbc968d tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:41.406624 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7668e90e-3636-48ba-a4a1-b3575bbc968d tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:41.407085 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7668e90e-3636-48ba-a4a1-b3575bbc968d tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:41.408576 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7668e90e-3636-48ba-a4a1-b3575bbc968d tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:41.408576 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7668e90e-3636-48ba-a4a1-b3575bbc968d tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:41.717770 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-db5b0927-3ac5-4d81-a603-3534c2b65302 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a299663b56b411b9fc910ddf47103e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d58bceb8414b02a1bbaec0db07d85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:41.727128 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-db5b0927-3ac5-4d81-a603-3534c2b65302 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] 10.222.0.20 "GET /compute/v2.1/servers/36dec2db-4166-4853-a79b-832ad7fc2730" status: 200 len: 1266 microversion: 2.1 time: 0.791165 Jul 22 11:21:41.727883 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 435/886] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:21:40 2022] GET /compute/v2.1/servers/36dec2db-4166-4853-a79b-832ad7fc2730 => generated 1266 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:21:41.832267 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-7668e90e-3636-48ba-a4a1-b3575bbc968d tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:41.851545 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-7668e90e-3636-48ba-a4a1-b3575bbc968d tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:41.853239 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-7668e90e-3636-48ba-a4a1-b3575bbc968d tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:41.854781 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-7668e90e-3636-48ba-a4a1-b3575bbc968d tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46" status: 200 len: 1673 microversion: 2.20 time: 0.466601 Jul 22 11:21:41.856590 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 452/887] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:21:41 2022] GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 => generated 1673 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:21:42.694608 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [req-8e447a5f-36f6-41c6-8b5f-9d6a6cae2ffa req-3a989b24-30ad-4d66-a546-efda43d33327 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36dec2db-4166-4853-a79b-832ad7fc2730", "tag": "de8e5933-745f-42ff-8fcb-dde4aff354a3"}]} {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:21:42.711183 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-8e447a5f-36f6-41c6-8b5f-9d6a6cae2ffa req-3a989b24-30ad-4d66-a546-efda43d33327 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:42.712010 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-8e447a5f-36f6-41c6-8b5f-9d6a6cae2ffa req-3a989b24-30ad-4d66-a546-efda43d33327 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:42.725095 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.compute.server_external_events [req-8e447a5f-36f6-41c6-8b5f-9d6a6cae2ffa req-3a989b24-30ad-4d66-a546-efda43d33327 service nova] Creating event network-changed:de8e5933-745f-42ff-8fcb-dde4aff354a3 for instance 36dec2db-4166-4853-a79b-832ad7fc2730 on hv-cinder-84890 Jul 22 11:21:42.730574 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [req-8e447a5f-36f6-41c6-8b5f-9d6a6cae2ffa req-3a989b24-30ad-4d66-a546-efda43d33327 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039673 Jul 22 11:21:42.731999 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 436/888] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:21:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:21:42.748875 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-e0a89688-0c00-4849-989f-ed0d849870f6 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:42.750084 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-e0a89688-0c00-4849-989f-ed0d849870f6 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] [instance: 36dec2db-4166-4853-a79b-832ad7fc2730] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:42.763413 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e0a89688-0c00-4849-989f-ed0d849870f6 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:42.770690 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e0a89688-0c00-4849-989f-ed0d849870f6 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:42.772667 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e0a89688-0c00-4849-989f-ed0d849870f6 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:42.779110 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e0a89688-0c00-4849-989f-ed0d849870f6 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:42.886181 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-9ef165ea-f23d-46ac-b6f2-b47a950193d3 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:42.887491 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-9ef165ea-f23d-46ac-b6f2-b47a950193d3 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:42.899246 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-9ef165ea-f23d-46ac-b6f2-b47a950193d3 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:42.900049 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-9ef165ea-f23d-46ac-b6f2-b47a950193d3 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:42.902541 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-9ef165ea-f23d-46ac-b6f2-b47a950193d3 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:42.903155 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-9ef165ea-f23d-46ac-b6f2-b47a950193d3 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:43.023289 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-e0a89688-0c00-4849-989f-ed0d849870f6 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a299663b56b411b9fc910ddf47103e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d58bceb8414b02a1bbaec0db07d85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:43.032550 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-e0a89688-0c00-4849-989f-ed0d849870f6 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] 10.222.0.20 "GET /compute/v2.1/servers/36dec2db-4166-4853-a79b-832ad7fc2730" status: 200 len: 1266 microversion: 2.1 time: 0.290756 Jul 22 11:21:43.036600 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 453/889] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:21:42 2022] GET /compute/v2.1/servers/36dec2db-4166-4853-a79b-832ad7fc2730 => generated 1266 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:21:43.283122 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-9ef165ea-f23d-46ac-b6f2-b47a950193d3 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:43.294068 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-9ef165ea-f23d-46ac-b6f2-b47a950193d3 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:43.295597 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-9ef165ea-f23d-46ac-b6f2-b47a950193d3 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:43.296787 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-9ef165ea-f23d-46ac-b6f2-b47a950193d3 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46" status: 200 len: 1673 microversion: 2.20 time: 0.424851 Jul 22 11:21:43.297347 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 437/890] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:21:42 2022] GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 => generated 1673 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:21:44.056324 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-f3cb4666-09ad-4395-a877-42af7fdde00c tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:44.057519 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-f3cb4666-09ad-4395-a877-42af7fdde00c tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] [instance: 36dec2db-4166-4853-a79b-832ad7fc2730] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:44.064550 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f3cb4666-09ad-4395-a877-42af7fdde00c tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:44.065242 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f3cb4666-09ad-4395-a877-42af7fdde00c tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:44.066182 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f3cb4666-09ad-4395-a877-42af7fdde00c tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:44.066632 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f3cb4666-09ad-4395-a877-42af7fdde00c tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:44.246926 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-f3cb4666-09ad-4395-a877-42af7fdde00c tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a299663b56b411b9fc910ddf47103e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d58bceb8414b02a1bbaec0db07d85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:44.262855 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-f3cb4666-09ad-4395-a877-42af7fdde00c tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] 10.222.0.20 "GET /compute/v2.1/servers/36dec2db-4166-4853-a79b-832ad7fc2730" status: 200 len: 1266 microversion: 2.1 time: 0.210141 Jul 22 11:21:44.275813 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 454/891] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:21:44 2022] GET /compute/v2.1/servers/36dec2db-4166-4853-a79b-832ad7fc2730 => generated 1266 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:21:44.318000 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-ccdf4493-b20a-4b2c-b828-d71052ee66bc tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:44.319419 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-ccdf4493-b20a-4b2c-b828-d71052ee66bc tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:44.334010 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-ccdf4493-b20a-4b2c-b828-d71052ee66bc tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:44.334641 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-ccdf4493-b20a-4b2c-b828-d71052ee66bc tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:44.335487 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-ccdf4493-b20a-4b2c-b828-d71052ee66bc tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:44.335927 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-ccdf4493-b20a-4b2c-b828-d71052ee66bc tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:44.657606 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-ccdf4493-b20a-4b2c-b828-d71052ee66bc tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:44.670257 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-ccdf4493-b20a-4b2c-b828-d71052ee66bc tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:44.672862 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-ccdf4493-b20a-4b2c-b828-d71052ee66bc tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:44.675369 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-ccdf4493-b20a-4b2c-b828-d71052ee66bc tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46" status: 200 len: 1731 microversion: 2.20 time: 0.363115 Jul 22 11:21:44.676068 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 438/892] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:21:44 2022] GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 => generated 1731 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:21:45.283075 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-d3bae946-c3b1-4720-b04a-9046de27c3fa tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:45.283933 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-d3bae946-c3b1-4720-b04a-9046de27c3fa tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] [instance: 36dec2db-4166-4853-a79b-832ad7fc2730] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:45.291841 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d3bae946-c3b1-4720-b04a-9046de27c3fa tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:45.292450 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d3bae946-c3b1-4720-b04a-9046de27c3fa tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:45.293394 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d3bae946-c3b1-4720-b04a-9046de27c3fa tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:45.293933 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d3bae946-c3b1-4720-b04a-9046de27c3fa tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:45.444807 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-d3bae946-c3b1-4720-b04a-9046de27c3fa tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a299663b56b411b9fc910ddf47103e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d58bceb8414b02a1bbaec0db07d85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:45.457779 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-d3bae946-c3b1-4720-b04a-9046de27c3fa tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] 10.222.0.20 "GET /compute/v2.1/servers/36dec2db-4166-4853-a79b-832ad7fc2730" status: 200 len: 1266 microversion: 2.1 time: 0.179957 Jul 22 11:21:45.467802 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 455/893] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:21:45 2022] GET /compute/v2.1/servers/36dec2db-4166-4853-a79b-832ad7fc2730 => generated 1266 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:21:45.502329 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-35feb6d5-e892-4e9b-a731-e17029b2bce9 tempest-VolumesTestJSON-2058418830 tempest-VolumesTestJSON-2058418830-project] Calling method '.version_select at 0x7f844505a790>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:45.580715 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-35feb6d5-e892-4e9b-a731-e17029b2bce9 tempest-VolumesTestJSON-2058418830 tempest-VolumesTestJSON-2058418830-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/2ec09d16-3eb0-427b-b503-303390ada9cc" status: 200 len: 351 microversion: 2.1 time: 0.081938 Jul 22 11:21:45.583465 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 439/894] 10.222.0.20 () {58 vars in 1244 bytes} [Fri Jul 22 11:21:45 2022] GET /compute/v2.1/os-volumes/2ec09d16-3eb0-427b-b503-303390ada9cc => generated 351 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:21:45.694942 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-567a6e47-189b-4b0d-b704-9c0d55ee7701 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:45.695968 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-567a6e47-189b-4b0d-b704-9c0d55ee7701 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:45.706949 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-567a6e47-189b-4b0d-b704-9c0d55ee7701 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:45.708172 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-567a6e47-189b-4b0d-b704-9c0d55ee7701 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:45.710395 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-567a6e47-189b-4b0d-b704-9c0d55ee7701 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:45.711832 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-567a6e47-189b-4b0d-b704-9c0d55ee7701 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:45.959649 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-567a6e47-189b-4b0d-b704-9c0d55ee7701 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:45.975003 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-567a6e47-189b-4b0d-b704-9c0d55ee7701 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:45.977192 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-567a6e47-189b-4b0d-b704-9c0d55ee7701 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:45.978659 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-567a6e47-189b-4b0d-b704-9c0d55ee7701 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46" status: 200 len: 1731 microversion: 2.20 time: 0.288051 Jul 22 11:21:45.993222 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 456/895] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:21:45 2022] GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 => generated 1731 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:21:46.475311 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-09d5dc47-aa71-43ab-9266-0581d75e5257 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:46.475824 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-09d5dc47-aa71-43ab-9266-0581d75e5257 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] [instance: 36dec2db-4166-4853-a79b-832ad7fc2730] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:46.482483 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-09d5dc47-aa71-43ab-9266-0581d75e5257 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:46.483183 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-09d5dc47-aa71-43ab-9266-0581d75e5257 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:46.484166 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-09d5dc47-aa71-43ab-9266-0581d75e5257 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:46.484769 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-09d5dc47-aa71-43ab-9266-0581d75e5257 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:46.655672 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-09d5dc47-aa71-43ab-9266-0581d75e5257 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a299663b56b411b9fc910ddf47103e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d58bceb8414b02a1bbaec0db07d85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:46.673782 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-09d5dc47-aa71-43ab-9266-0581d75e5257 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] 10.222.0.20 "GET /compute/v2.1/servers/36dec2db-4166-4853-a79b-832ad7fc2730" status: 200 len: 1266 microversion: 2.1 time: 0.201890 Jul 22 11:21:46.684221 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 440/896] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:21:46 2022] GET /compute/v2.1/servers/36dec2db-4166-4853-a79b-832ad7fc2730 => generated 1266 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:21:47.000600 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-ce723dd0-560b-4907-917f-0a34dd10448c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:47.001646 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-ce723dd0-560b-4907-917f-0a34dd10448c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:47.007802 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ce723dd0-560b-4907-917f-0a34dd10448c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:47.008256 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ce723dd0-560b-4907-917f-0a34dd10448c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:47.009040 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ce723dd0-560b-4907-917f-0a34dd10448c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:47.009613 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ce723dd0-560b-4907-917f-0a34dd10448c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:47.203637 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-ce723dd0-560b-4907-917f-0a34dd10448c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:47.216498 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-ce723dd0-560b-4907-917f-0a34dd10448c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:47.218806 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-ce723dd0-560b-4907-917f-0a34dd10448c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:47.223984 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-ce723dd0-560b-4907-917f-0a34dd10448c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46" status: 200 len: 1731 microversion: 2.20 time: 0.227512 Jul 22 11:21:47.235149 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 457/897] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:21:46 2022] GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 => generated 1731 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:21:47.252164 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-b37c4bfa-2b47-4309-9788-a8309ac3d275 tempest-VolumesTestJSON-2058418830 tempest-VolumesTestJSON-2058418830-project] Calling method '.version_select at 0x7f84450244c0>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:47.330331 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-b37c4bfa-2b47-4309-9788-a8309ac3d275 tempest-VolumesTestJSON-2058418830 tempest-VolumesTestJSON-2058418830-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/d4dbd466-47e2-4e8b-bfc3-f5e65fcbe5d3" status: 200 len: 350 microversion: 2.1 time: 0.082788 Jul 22 11:21:47.335249 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 441/898] 10.222.0.20 () {58 vars in 1244 bytes} [Fri Jul 22 11:21:47 2022] GET /compute/v2.1/os-volumes/d4dbd466-47e2-4e8b-bfc3-f5e65fcbe5d3 => generated 350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:21:47.692168 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-82876ad4-44b3-4599-b467-8aadb9b6a4b4 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:47.692812 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-82876ad4-44b3-4599-b467-8aadb9b6a4b4 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] [instance: 36dec2db-4166-4853-a79b-832ad7fc2730] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:47.700823 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-82876ad4-44b3-4599-b467-8aadb9b6a4b4 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:47.701499 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-82876ad4-44b3-4599-b467-8aadb9b6a4b4 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:47.702468 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-82876ad4-44b3-4599-b467-8aadb9b6a4b4 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:47.702923 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-82876ad4-44b3-4599-b467-8aadb9b6a4b4 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:47.907078 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-82876ad4-44b3-4599-b467-8aadb9b6a4b4 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a299663b56b411b9fc910ddf47103e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d58bceb8414b02a1bbaec0db07d85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:47.916516 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-82876ad4-44b3-4599-b467-8aadb9b6a4b4 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] 10.222.0.20 "GET /compute/v2.1/servers/36dec2db-4166-4853-a79b-832ad7fc2730" status: 200 len: 1266 microversion: 2.1 time: 0.229138 Jul 22 11:21:47.917100 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 458/899] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:21:47 2022] GET /compute/v2.1/servers/36dec2db-4166-4853-a79b-832ad7fc2730 => generated 1266 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:21:48.244791 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-c2a374a9-ee3a-4041-9609-51d681ba78fb tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:48.246028 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-c2a374a9-ee3a-4041-9609-51d681ba78fb tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:48.255002 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c2a374a9-ee3a-4041-9609-51d681ba78fb tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:48.255657 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c2a374a9-ee3a-4041-9609-51d681ba78fb tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:48.256701 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c2a374a9-ee3a-4041-9609-51d681ba78fb tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:48.257433 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c2a374a9-ee3a-4041-9609-51d681ba78fb tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:48.297522 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG dbcounter [-] [117884] Writing DB stats nova_cell0:SELECT=2 {{(pid=117884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:21:48.440216 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-c2a374a9-ee3a-4041-9609-51d681ba78fb tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:48.452223 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-c2a374a9-ee3a-4041-9609-51d681ba78fb tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:48.454042 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-c2a374a9-ee3a-4041-9609-51d681ba78fb tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:48.456071 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-c2a374a9-ee3a-4041-9609-51d681ba78fb tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46" status: 200 len: 1731 microversion: 2.20 time: 0.215320 Jul 22 11:21:48.457117 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 442/900] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:21:48 2022] GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 => generated 1731 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:21:48.754816 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-af0de4bc-70b4-456e-895d-76f60703947f tempest-VolumesTestJSON-2058418830 tempest-VolumesTestJSON-2058418830-project] Calling method '.version_select at 0x7f84451df0d0>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:48.819477 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-af0de4bc-70b4-456e-895d-76f60703947f tempest-VolumesTestJSON-2058418830 tempest-VolumesTestJSON-2058418830-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/93e08519-292c-4132-88e4-fd8dee4256d4" status: 200 len: 351 microversion: 2.1 time: 0.068563 Jul 22 11:21:48.819941 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 459/901] 10.222.0.20 () {58 vars in 1244 bytes} [Fri Jul 22 11:21:48 2022] GET /compute/v2.1/os-volumes/93e08519-292c-4132-88e4-fd8dee4256d4 => generated 351 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:21:48.832741 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-93cbd880-ebbd-46fb-bd72-2df99e1befe9 tempest-VolumesTestJSON-2058418830 tempest-VolumesTestJSON-2058418830-project] Calling method '.version_select at 0x7f844505a790>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:48.840846 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG dbcounter [-] [117884] Writing DB stats nova_cell0:SELECT=8 {{(pid=117884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:21:48.933397 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-93cbd880-ebbd-46fb-bd72-2df99e1befe9 tempest-VolumesTestJSON-2058418830 tempest-VolumesTestJSON-2058418830-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.105581 Jul 22 11:21:48.934437 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-cd48a913-e48b-4974-bf6d-31e7835e4349 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:48.935064 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-cd48a913-e48b-4974-bf6d-31e7835e4349 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] [instance: 36dec2db-4166-4853-a79b-832ad7fc2730] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:48.939788 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 443/902] 10.222.0.20 () {58 vars in 1133 bytes} [Fri Jul 22 11:21:48 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:21:48.949909 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-cd48a913-e48b-4974-bf6d-31e7835e4349 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:48.950632 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-cd48a913-e48b-4974-bf6d-31e7835e4349 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:48.951626 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-cd48a913-e48b-4974-bf6d-31e7835e4349 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:48.952226 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-cd48a913-e48b-4974-bf6d-31e7835e4349 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:48.953323 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-4fdb39c0-8468-4e9f-a277-feb2b5e8b28f tempest-VolumesTestJSON-2058418830 tempest-VolumesTestJSON-2058418830-project] Calling method '.version_select at 0x7f8445024430>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:49.055602 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-4fdb39c0-8468-4e9f-a277-feb2b5e8b28f tempest-VolumesTestJSON-2058418830 tempest-VolumesTestJSON-2058418830-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.105921 Jul 22 11:21:49.056863 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 444/903] 10.222.0.20 () {58 vars in 1148 bytes} [Fri Jul 22 11:21:48 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 22 11:21:49.069654 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-f329a51a-14bb-4802-85c8-68c2c979e511 tempest-VolumesTestJSON-2058418830 tempest-VolumesTestJSON-2058418830-project] Calling method '.version_select at 0x7f84450fbf70>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:49.195528 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-f329a51a-14bb-4802-85c8-68c2c979e511 tempest-VolumesTestJSON-2058418830 tempest-VolumesTestJSON-2058418830-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.130439 Jul 22 11:21:49.196501 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 445/904] 10.222.0.20 () {58 vars in 1133 bytes} [Fri Jul 22 11:21:49 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:21:49.208583 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-95198d92-95c9-435a-a923-e86ae154ee6d tempest-VolumesTestJSON-2058418830 tempest-VolumesTestJSON-2058418830-project] Calling method '.version_select at 0x7f84450fb5e0>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:49.287158 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-cd48a913-e48b-4974-bf6d-31e7835e4349 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a299663b56b411b9fc910ddf47103e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d58bceb8414b02a1bbaec0db07d85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:49.302563 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-cd48a913-e48b-4974-bf6d-31e7835e4349 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] 10.222.0.20 "GET /compute/v2.1/servers/36dec2db-4166-4853-a79b-832ad7fc2730" status: 200 len: 1266 microversion: 2.1 time: 0.371956 Jul 22 11:21:49.303492 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 460/905] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:21:48 2022] GET /compute/v2.1/servers/36dec2db-4166-4853-a79b-832ad7fc2730 => generated 1266 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:21:49.342561 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-95198d92-95c9-435a-a923-e86ae154ee6d tempest-VolumesTestJSON-2058418830 tempest-VolumesTestJSON-2058418830-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.138579 Jul 22 11:21:49.343360 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 446/906] 10.222.0.20 () {58 vars in 1166 bytes} [Fri Jul 22 11:21:49 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 22 11:21:49.355760 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-3c4b6f48-98e7-4faa-b5fb-6794f1143bd3 tempest-VolumesTestJSON-2058418830 tempest-VolumesTestJSON-2058418830-project] Calling method '.version_select at 0x7f84451df0d0>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:49.450872 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-3c4b6f48-98e7-4faa-b5fb-6794f1143bd3 tempest-VolumesTestJSON-2058418830 tempest-VolumesTestJSON-2058418830-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.098832 Jul 22 11:21:49.464372 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 461/907] 10.222.0.20 () {58 vars in 1169 bytes} [Fri Jul 22 11:21:49 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:21:49.465268 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-098aa955-cbb4-4865-88ba-92818d8b2471 tempest-VolumesTestJSON-2058418830 tempest-VolumesTestJSON-2058418830-project] Calling method '.version_select at 0x7f844507cdc0>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:49.475778 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-855d4370-2bab-4145-8342-531be73cb6f3 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:49.476392 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-855d4370-2bab-4145-8342-531be73cb6f3 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:49.498557 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-855d4370-2bab-4145-8342-531be73cb6f3 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:49.499021 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-855d4370-2bab-4145-8342-531be73cb6f3 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:49.499839 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-855d4370-2bab-4145-8342-531be73cb6f3 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:49.500431 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-855d4370-2bab-4145-8342-531be73cb6f3 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:49.603309 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-098aa955-cbb4-4865-88ba-92818d8b2471 tempest-VolumesTestJSON-2058418830 tempest-VolumesTestJSON-2058418830-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.142483 Jul 22 11:21:49.604130 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 447/908] 10.222.0.20 () {58 vars in 1154 bytes} [Fri Jul 22 11:21:49 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:21:49.615329 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-ad2574bd-8420-4e8b-a520-bf5d1aea1234 tempest-VolumesTestJSON-2058418830 tempest-VolumesTestJSON-2058418830-project] Calling method '.version_select at 0x7f844505a9d0>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:49.733992 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-ad2574bd-8420-4e8b-a520-bf5d1aea1234 tempest-VolumesTestJSON-2058418830 tempest-VolumesTestJSON-2058418830-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.122511 Jul 22 11:21:49.734561 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 448/909] 10.222.0.20 () {58 vars in 1187 bytes} [Fri Jul 22 11:21:49 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 22 11:21:49.749679 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-5b8b30cb-4832-4ac5-8f44-8fce3aa90f24 tempest-VolumesTestJSON-2058418830 tempest-VolumesTestJSON-2058418830-project] Calling method '.version_select at 0x7f844505ac10>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:49.764825 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-855d4370-2bab-4145-8342-531be73cb6f3 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:49.780525 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-855d4370-2bab-4145-8342-531be73cb6f3 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:49.782060 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-855d4370-2bab-4145-8342-531be73cb6f3 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:49.783322 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-855d4370-2bab-4145-8342-531be73cb6f3 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46" status: 200 len: 1731 microversion: 2.20 time: 0.311847 Jul 22 11:21:49.784377 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 462/910] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:21:49 2022] GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 => generated 1731 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 22 11:21:49.871918 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-5b8b30cb-4832-4ac5-8f44-8fce3aa90f24 tempest-VolumesTestJSON-2058418830 tempest-VolumesTestJSON-2058418830-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.127090 Jul 22 11:21:49.872588 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 449/911] 10.222.0.20 () {58 vars in 1154 bytes} [Fri Jul 22 11:21:49 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:21:50.326133 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-999dba4e-e0de-474b-84e6-ab69f9035b19 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:50.327632 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-999dba4e-e0de-474b-84e6-ab69f9035b19 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] [instance: 36dec2db-4166-4853-a79b-832ad7fc2730] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:50.340069 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-999dba4e-e0de-474b-84e6-ab69f9035b19 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:50.341242 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-999dba4e-e0de-474b-84e6-ab69f9035b19 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:50.343029 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-999dba4e-e0de-474b-84e6-ab69f9035b19 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:50.344658 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-999dba4e-e0de-474b-84e6-ab69f9035b19 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:50.506358 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-999dba4e-e0de-474b-84e6-ab69f9035b19 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a299663b56b411b9fc910ddf47103e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d58bceb8414b02a1bbaec0db07d85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:50.514856 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-999dba4e-e0de-474b-84e6-ab69f9035b19 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] 10.222.0.20 "GET /compute/v2.1/servers/36dec2db-4166-4853-a79b-832ad7fc2730" status: 200 len: 1266 microversion: 2.1 time: 0.198323 Jul 22 11:21:50.524503 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 463/912] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:21:50 2022] GET /compute/v2.1/servers/36dec2db-4166-4853-a79b-832ad7fc2730 => generated 1266 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:21:50.805374 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-81f749a2-2ce4-45a9-8d63-d9dec0170553 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:50.805979 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-81f749a2-2ce4-45a9-8d63-d9dec0170553 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:50.812418 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-81f749a2-2ce4-45a9-8d63-d9dec0170553 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:50.813092 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-81f749a2-2ce4-45a9-8d63-d9dec0170553 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:50.814681 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-81f749a2-2ce4-45a9-8d63-d9dec0170553 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:50.815286 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-81f749a2-2ce4-45a9-8d63-d9dec0170553 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:50.955894 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-81f749a2-2ce4-45a9-8d63-d9dec0170553 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:50.964693 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-81f749a2-2ce4-45a9-8d63-d9dec0170553 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:50.966209 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-81f749a2-2ce4-45a9-8d63-d9dec0170553 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:50.968328 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-81f749a2-2ce4-45a9-8d63-d9dec0170553 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46" status: 200 len: 1731 microversion: 2.20 time: 0.167341 Jul 22 11:21:50.968900 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 450/913] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:21:50 2022] GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:21:51.533417 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-60b34740-9ccb-4fa0-b288-8d60a066d0d9 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:51.534671 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-60b34740-9ccb-4fa0-b288-8d60a066d0d9 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] [instance: 36dec2db-4166-4853-a79b-832ad7fc2730] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:51.545206 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-60b34740-9ccb-4fa0-b288-8d60a066d0d9 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:51.546377 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-60b34740-9ccb-4fa0-b288-8d60a066d0d9 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:51.548321 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-60b34740-9ccb-4fa0-b288-8d60a066d0d9 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:51.557076 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-60b34740-9ccb-4fa0-b288-8d60a066d0d9 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:51.738647 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-60b34740-9ccb-4fa0-b288-8d60a066d0d9 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a299663b56b411b9fc910ddf47103e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d58bceb8414b02a1bbaec0db07d85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:51.748379 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-60b34740-9ccb-4fa0-b288-8d60a066d0d9 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] 10.222.0.20 "GET /compute/v2.1/servers/36dec2db-4166-4853-a79b-832ad7fc2730" status: 200 len: 1266 microversion: 2.1 time: 0.220011 Jul 22 11:21:51.749110 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 464/914] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:21:51 2022] GET /compute/v2.1/servers/36dec2db-4166-4853-a79b-832ad7fc2730 => generated 1266 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:21:51.991140 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-8236492f-b240-49c7-8d44-10ad992fbc47 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:51.991929 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-8236492f-b240-49c7-8d44-10ad992fbc47 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:52.002725 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-8236492f-b240-49c7-8d44-10ad992fbc47 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:52.003167 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-8236492f-b240-49c7-8d44-10ad992fbc47 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:52.003976 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-8236492f-b240-49c7-8d44-10ad992fbc47 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:52.004405 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-8236492f-b240-49c7-8d44-10ad992fbc47 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:52.168371 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-8236492f-b240-49c7-8d44-10ad992fbc47 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:52.177535 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-8236492f-b240-49c7-8d44-10ad992fbc47 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:52.179043 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-8236492f-b240-49c7-8d44-10ad992fbc47 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:52.180244 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-8236492f-b240-49c7-8d44-10ad992fbc47 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46" status: 200 len: 1731 microversion: 2.20 time: 0.196182 Jul 22 11:21:52.180802 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 451/915] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:21:51 2022] GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 => generated 1731 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:21:52.769210 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-5986fa52-5851-4757-97d7-ab065660d178 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:52.770748 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-5986fa52-5851-4757-97d7-ab065660d178 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] [instance: 36dec2db-4166-4853-a79b-832ad7fc2730] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:52.778265 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5986fa52-5851-4757-97d7-ab065660d178 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:52.779058 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5986fa52-5851-4757-97d7-ab065660d178 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:52.780077 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5986fa52-5851-4757-97d7-ab065660d178 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:52.782800 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5986fa52-5851-4757-97d7-ab065660d178 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:52.966276 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-5986fa52-5851-4757-97d7-ab065660d178 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a299663b56b411b9fc910ddf47103e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d58bceb8414b02a1bbaec0db07d85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:52.982022 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-5986fa52-5851-4757-97d7-ab065660d178 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] 10.222.0.20 "GET /compute/v2.1/servers/36dec2db-4166-4853-a79b-832ad7fc2730" status: 200 len: 1266 microversion: 2.1 time: 0.220397 Jul 22 11:21:52.993745 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 465/916] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:21:52 2022] GET /compute/v2.1/servers/36dec2db-4166-4853-a79b-832ad7fc2730 => generated 1266 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:21:53.198512 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-04f7b3af-89bd-40b8-9560-4533441c6c7c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:53.199798 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-04f7b3af-89bd-40b8-9560-4533441c6c7c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:53.206526 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG dbcounter [-] [117884] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:21:53.208801 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-04f7b3af-89bd-40b8-9560-4533441c6c7c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:53.209467 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-04f7b3af-89bd-40b8-9560-4533441c6c7c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:53.210415 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-04f7b3af-89bd-40b8-9560-4533441c6c7c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:53.211005 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-04f7b3af-89bd-40b8-9560-4533441c6c7c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:53.232021 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG dbcounter [-] [117884] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:21:53.371056 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-04f7b3af-89bd-40b8-9560-4533441c6c7c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:53.381304 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-04f7b3af-89bd-40b8-9560-4533441c6c7c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:53.383872 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-04f7b3af-89bd-40b8-9560-4533441c6c7c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:53.385377 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-04f7b3af-89bd-40b8-9560-4533441c6c7c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46" status: 200 len: 1731 microversion: 2.20 time: 0.190762 Jul 22 11:21:53.386058 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 452/917] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:21:53 2022] GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 => generated 1731 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:21:54.001354 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-b114982f-d4a9-4e39-a522-1686cbd9a874 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:54.003487 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-b114982f-d4a9-4e39-a522-1686cbd9a874 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] [instance: 36dec2db-4166-4853-a79b-832ad7fc2730] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:54.009382 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:21:54.011297 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b114982f-d4a9-4e39-a522-1686cbd9a874 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:54.011787 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b114982f-d4a9-4e39-a522-1686cbd9a874 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:54.012582 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b114982f-d4a9-4e39-a522-1686cbd9a874 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:54.012946 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b114982f-d4a9-4e39-a522-1686cbd9a874 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:54.175111 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-b114982f-d4a9-4e39-a522-1686cbd9a874 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a299663b56b411b9fc910ddf47103e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d58bceb8414b02a1bbaec0db07d85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:54.184942 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-b114982f-d4a9-4e39-a522-1686cbd9a874 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] 10.222.0.20 "GET /compute/v2.1/servers/36dec2db-4166-4853-a79b-832ad7fc2730" status: 200 len: 1266 microversion: 2.1 time: 0.187287 Jul 22 11:21:54.186019 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 466/918] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:21:53 2022] GET /compute/v2.1/servers/36dec2db-4166-4853-a79b-832ad7fc2730 => generated 1266 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:21:54.408673 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-040eb48a-9403-4349-b677-8be8ec593a98 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:54.409766 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-040eb48a-9403-4349-b677-8be8ec593a98 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:54.419149 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-040eb48a-9403-4349-b677-8be8ec593a98 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:54.419836 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-040eb48a-9403-4349-b677-8be8ec593a98 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:54.420434 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-040eb48a-9403-4349-b677-8be8ec593a98 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:54.421048 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-040eb48a-9403-4349-b677-8be8ec593a98 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:54.585520 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-040eb48a-9403-4349-b677-8be8ec593a98 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:54.597240 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-040eb48a-9403-4349-b677-8be8ec593a98 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:54.599547 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-040eb48a-9403-4349-b677-8be8ec593a98 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:54.601505 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-040eb48a-9403-4349-b677-8be8ec593a98 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46" status: 200 len: 1731 microversion: 2.20 time: 0.200137 Jul 22 11:21:54.602862 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 453/919] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:21:54 2022] GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 => generated 1731 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:21:55.207047 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-e0b2bcf2-7412-4429-b5dc-261b5c7e0c26 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:55.207699 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-e0b2bcf2-7412-4429-b5dc-261b5c7e0c26 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] [instance: 36dec2db-4166-4853-a79b-832ad7fc2730] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:55.216664 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-e0b2bcf2-7412-4429-b5dc-261b5c7e0c26 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:55.216664 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-e0b2bcf2-7412-4429-b5dc-261b5c7e0c26 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:55.218846 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-e0b2bcf2-7412-4429-b5dc-261b5c7e0c26 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:55.218846 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-e0b2bcf2-7412-4429-b5dc-261b5c7e0c26 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:55.344359 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-d5c28d51-fd3f-4fe0-ba6f-5a9e9f3c39fc tempest-VolumesNegativeTest-1964132410 tempest-VolumesNegativeTest-1964132410-project] Action: 'create', calling method: .version_select at 0x7f84452e2550>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-569405178", "metadata": {"Type": "work"}}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:21:55.358941 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-e0b2bcf2-7412-4429-b5dc-261b5c7e0c26 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a299663b56b411b9fc910ddf47103e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d58bceb8414b02a1bbaec0db07d85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:55.364935 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-d5c28d51-fd3f-4fe0-ba6f-5a9e9f3c39fc tempest-VolumesNegativeTest-1964132410 tempest-VolumesNegativeTest-1964132410-project] Request method failure captured: Jul 22 11:21:55.364935 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 22 11:21:55.364935 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Accept: application/json Jul 22 11:21:55.364935 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Accept-Encoding: identity Jul 22 11:21:55.364935 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Connection: close Jul 22 11:21:55.364935 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Content-Length: 121 Jul 22 11:21:55.364935 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Content-Type: application/json Jul 22 11:21:55.364935 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Host: 10.222.0.20 Jul 22 11:21:55.364935 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Openstack-System-Scope: None Jul 22 11:21:55.364935 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: User-Agent: python-urllib3/1.26.9 Jul 22 11:21:55.364935 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Auth-Token: gAAAAABi2ohTXRE9tHGlypYMqs47d-I3a6QN1PLP6tB1Zcg5cw31oqhU56s7z5ejOtaJ5B53-ofOnvcVHhfLNe6via8FJWD05Ow2Mwl0e8TsYSEaPLPTIaI5o3BVVAcsJwtT80P3RFAZQWD7lJbyHfB7vdAHdx0JnI2d1q75tSwE26T6bZ-ihsI Jul 22 11:21:55.364935 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Domain-Id: None Jul 22 11:21:55.364935 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Domain-Name: None Jul 22 11:21:55.364935 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Identity-Status: Confirmed Jul 22 11:21:55.364935 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Is-Admin-Project: True Jul 22 11:21:55.364935 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Project-Domain-Id: default Jul 22 11:21:55.364935 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Project-Domain-Name: Default Jul 22 11:21:55.364935 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Project-Id: 79c057e14b644edabf55e555d4a18b4b Jul 22 11:21:55.364935 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Project-Name: tempest-VolumesNegativeTest-1964132410 Jul 22 11:21:55.364935 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Role: reader,member Jul 22 11:21:55.364935 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Roles: reader,member Jul 22 11:21:55.366559 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/79c057e14b644edabf55e555d4a18b4b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_79c057e14b644edabf55e555d4a18b4b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/79c057e14b644edabf55e555d4a18b4b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/79c057e14b644edabf55e555d4a18b4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jul 22 11:21:55.366559 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Tenant: tempest-VolumesNegativeTest-1964132410 Jul 22 11:21:55.366559 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Tenant-Id: 79c057e14b644edabf55e555d4a18b4b Jul 22 11:21:55.366559 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Tenant-Name: tempest-VolumesNegativeTest-1964132410 Jul 22 11:21:55.366559 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User: tempest-VolumesNegativeTest-1964132410-project Jul 22 11:21:55.366559 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User-Domain-Id: default Jul 22 11:21:55.366559 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User-Domain-Name: Default Jul 22 11:21:55.366559 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User-Id: 86a14eb1c314449892281892a0f6bd7b Jul 22 11:21:55.366559 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User-Name: tempest-VolumesNegativeTest-1964132410-project Jul 22 11:21:55.366559 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Jul 22 11:21:55.366559 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-569405178", "metadata": {"Type": "work"}}} Jul 22 11:21:55.366559 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: method: Jul 22 11:21:55.366559 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 22 11:21:55.368392 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-569405178', 'metadata': {'Type': 'work'}}}} Jul 22 11:21:55.368392 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 22 11:21:55.368392 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:21:55.368392 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 22 11:21:55.368392 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 22 11:21:55.368392 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 22 11:21:55.368392 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise error Jul 22 11:21:55.368392 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 22 11:21:55.368392 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:21:55.368392 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 22 11:21:55.368392 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 22 11:21:55.368392 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:21:55.368392 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 22 11:21:55.368392 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi '#$%' Jul 22 11:21:55.368392 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:21:55.368392 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:21:55.368392 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:21:55.368392 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:21:55.368392 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:21:55.368392 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:21:55.368392 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 22 11:21:55.368392 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 22 11:21:55.370665 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 22 11:21:55.370665 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 22 11:21:55.370665 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 22 11:21:55.370665 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 22 11:21:55.370665 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 22 11:21:55.370665 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 22 11:21:55.370665 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 22 11:21:55.370665 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 22 11:21:55.370665 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 22 11:21:55.370665 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 22 11:21:55.370665 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 22 11:21:55.370665 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:21:55.370665 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:21:55.370665 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:21:55.370665 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:21:55.370665 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:21:55.370665 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:21:55.370665 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 22 11:21:55.370665 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 22 11:21:55.371902 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 22 11:21:55.371902 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:21:55.371902 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-d5c28d51-fd3f-4fe0-ba6f-5a9e9f3c39fc tempest-VolumesNegativeTest-1964132410 tempest-VolumesNegativeTest-1964132410-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 22 11:21:55.371902 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-d5c28d51-fd3f-4fe0-ba6f-5a9e9f3c39fc tempest-VolumesNegativeTest-1964132410 tempest-VolumesNegativeTest-1964132410-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.192859 Jul 22 11:21:55.372241 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-e0b2bcf2-7412-4429-b5dc-261b5c7e0c26 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] 10.222.0.20 "GET /compute/v2.1/servers/36dec2db-4166-4853-a79b-832ad7fc2730" status: 200 len: 1266 microversion: 2.1 time: 0.167807 Jul 22 11:21:55.372349 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 467/920] 10.222.0.20 () {60 vars in 1155 bytes} [Fri Jul 22 11:21:55 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 195 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 22 11:21:55.372445 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 454/921] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:21:55 2022] GET /compute/v2.1/servers/36dec2db-4166-4853-a79b-832ad7fc2730 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:21:55.380923 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-d7b6e4aa-a81a-469f-8e5f-d3efef509219 tempest-VolumesNegativeTest-1964132410 tempest-VolumesNegativeTest-1964132410-project] Action: 'create', calling method: .version_select at 0x7f84451f1a60>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1385179227", "metadata": {"Type": "work"}}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:21:55.383599 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-d7b6e4aa-a81a-469f-8e5f-d3efef509219 tempest-VolumesNegativeTest-1964132410 tempest-VolumesNegativeTest-1964132410-project] Request method failure captured: Jul 22 11:21:55.383599 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 22 11:21:55.383599 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Accept: application/json Jul 22 11:21:55.383599 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Accept-Encoding: identity Jul 22 11:21:55.383599 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Connection: close Jul 22 11:21:55.383599 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Content-Length: 120 Jul 22 11:21:55.383599 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Content-Type: application/json Jul 22 11:21:55.383599 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Host: 10.222.0.20 Jul 22 11:21:55.383599 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Openstack-System-Scope: None Jul 22 11:21:55.383599 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: User-Agent: python-urllib3/1.26.9 Jul 22 11:21:55.383599 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Auth-Token: gAAAAABi2ohTXRE9tHGlypYMqs47d-I3a6QN1PLP6tB1Zcg5cw31oqhU56s7z5ejOtaJ5B53-ofOnvcVHhfLNe6via8FJWD05Ow2Mwl0e8TsYSEaPLPTIaI5o3BVVAcsJwtT80P3RFAZQWD7lJbyHfB7vdAHdx0JnI2d1q75tSwE26T6bZ-ihsI Jul 22 11:21:55.383599 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Domain-Id: None Jul 22 11:21:55.383599 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Domain-Name: None Jul 22 11:21:55.383599 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Identity-Status: Confirmed Jul 22 11:21:55.383599 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Is-Admin-Project: True Jul 22 11:21:55.383599 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Project-Domain-Id: default Jul 22 11:21:55.383599 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Project-Domain-Name: Default Jul 22 11:21:55.383599 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Project-Id: 79c057e14b644edabf55e555d4a18b4b Jul 22 11:21:55.383599 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Project-Name: tempest-VolumesNegativeTest-1964132410 Jul 22 11:21:55.383599 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Role: reader,member Jul 22 11:21:55.383599 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Roles: reader,member Jul 22 11:21:55.385112 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/79c057e14b644edabf55e555d4a18b4b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_79c057e14b644edabf55e555d4a18b4b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/79c057e14b644edabf55e555d4a18b4b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/79c057e14b644edabf55e555d4a18b4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jul 22 11:21:55.385112 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Tenant: tempest-VolumesNegativeTest-1964132410 Jul 22 11:21:55.385112 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Tenant-Id: 79c057e14b644edabf55e555d4a18b4b Jul 22 11:21:55.385112 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Tenant-Name: tempest-VolumesNegativeTest-1964132410 Jul 22 11:21:55.385112 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User: tempest-VolumesNegativeTest-1964132410-project Jul 22 11:21:55.385112 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User-Domain-Id: default Jul 22 11:21:55.385112 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User-Domain-Name: Default Jul 22 11:21:55.385112 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User-Id: 86a14eb1c314449892281892a0f6bd7b Jul 22 11:21:55.385112 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User-Name: tempest-VolumesNegativeTest-1964132410-project Jul 22 11:21:55.385112 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Jul 22 11:21:55.385112 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1385179227", "metadata": {"Type": "work"}}} Jul 22 11:21:55.385112 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: method: Jul 22 11:21:55.385112 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 22 11:21:55.386096 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1385179227', 'metadata': {'Type': 'work'}}}} Jul 22 11:21:55.386096 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 22 11:21:55.386096 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:21:55.386096 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 22 11:21:55.386096 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 22 11:21:55.386096 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 22 11:21:55.386096 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise error Jul 22 11:21:55.386096 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 22 11:21:55.386096 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:21:55.386096 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 22 11:21:55.386096 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 22 11:21:55.386096 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:21:55.386096 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 22 11:21:55.386096 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi '0' Jul 22 11:21:55.386096 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:21:55.386096 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:21:55.386096 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:21:55.386096 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:21:55.386096 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:21:55.386096 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:21:55.386096 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 22 11:21:55.386096 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 22 11:21:55.387747 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 22 11:21:55.387747 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 22 11:21:55.387747 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 22 11:21:55.387747 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 22 11:21:55.387747 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 22 11:21:55.387747 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 22 11:21:55.387747 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 22 11:21:55.387747 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 22 11:21:55.387747 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 22 11:21:55.387747 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 22 11:21:55.387747 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 22 11:21:55.387747 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:21:55.387747 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:21:55.387747 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:21:55.387747 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:21:55.387747 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:21:55.387747 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:21:55.387747 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 22 11:21:55.387747 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 22 11:21:55.389997 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 22 11:21:55.389997 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:21:55.389997 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-d7b6e4aa-a81a-469f-8e5f-d3efef509219 tempest-VolumesNegativeTest-1964132410 tempest-VolumesNegativeTest-1964132410-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 22 11:21:55.389997 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-d7b6e4aa-a81a-469f-8e5f-d3efef509219 tempest-VolumesNegativeTest-1964132410 tempest-VolumesNegativeTest-1964132410-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009330 Jul 22 11:21:55.389997 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 468/922] 10.222.0.20 () {60 vars in 1155 bytes} [Fri Jul 22 11:21:55 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 22 11:21:55.395277 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-4be6fd22-bd33-4dd4-abb5-9c00085ae529 tempest-VolumesNegativeTest-1964132410 tempest-VolumesNegativeTest-1964132410-project] Action: 'create', calling method: .version_select at 0x7f844503e700>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-768692611", "metadata": {"Type": "work"}}} {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:21:55.398720 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-4be6fd22-bd33-4dd4-abb5-9c00085ae529 tempest-VolumesNegativeTest-1964132410 tempest-VolumesNegativeTest-1964132410-project] Request method failure captured: Jul 22 11:21:55.398720 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 22 11:21:55.398720 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Accept: application/json Jul 22 11:21:55.398720 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Accept-Encoding: identity Jul 22 11:21:55.398720 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Connection: close Jul 22 11:21:55.398720 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Content-Length: 118 Jul 22 11:21:55.398720 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Content-Type: application/json Jul 22 11:21:55.398720 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Host: 10.222.0.20 Jul 22 11:21:55.398720 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Openstack-System-Scope: None Jul 22 11:21:55.398720 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: User-Agent: python-urllib3/1.26.9 Jul 22 11:21:55.398720 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Auth-Token: gAAAAABi2ohTXRE9tHGlypYMqs47d-I3a6QN1PLP6tB1Zcg5cw31oqhU56s7z5ejOtaJ5B53-ofOnvcVHhfLNe6via8FJWD05Ow2Mwl0e8TsYSEaPLPTIaI5o3BVVAcsJwtT80P3RFAZQWD7lJbyHfB7vdAHdx0JnI2d1q75tSwE26T6bZ-ihsI Jul 22 11:21:55.398720 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Domain-Id: None Jul 22 11:21:55.398720 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Domain-Name: None Jul 22 11:21:55.398720 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Identity-Status: Confirmed Jul 22 11:21:55.398720 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Is-Admin-Project: True Jul 22 11:21:55.398720 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Domain-Id: default Jul 22 11:21:55.398720 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Domain-Name: Default Jul 22 11:21:55.398720 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Id: 79c057e14b644edabf55e555d4a18b4b Jul 22 11:21:55.398720 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Name: tempest-VolumesNegativeTest-1964132410 Jul 22 11:21:55.398720 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Role: reader,member Jul 22 11:21:55.398720 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Roles: reader,member Jul 22 11:21:55.400398 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/79c057e14b644edabf55e555d4a18b4b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_79c057e14b644edabf55e555d4a18b4b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/79c057e14b644edabf55e555d4a18b4b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/79c057e14b644edabf55e555d4a18b4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jul 22 11:21:55.400398 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant: tempest-VolumesNegativeTest-1964132410 Jul 22 11:21:55.400398 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant-Id: 79c057e14b644edabf55e555d4a18b4b Jul 22 11:21:55.400398 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant-Name: tempest-VolumesNegativeTest-1964132410 Jul 22 11:21:55.400398 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User: tempest-VolumesNegativeTest-1964132410-project Jul 22 11:21:55.400398 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Domain-Id: default Jul 22 11:21:55.400398 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Domain-Name: Default Jul 22 11:21:55.400398 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Id: 86a14eb1c314449892281892a0f6bd7b Jul 22 11:21:55.400398 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Name: tempest-VolumesNegativeTest-1964132410-project Jul 22 11:21:55.400398 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Jul 22 11:21:55.400398 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-768692611", "metadata": {"Type": "work"}}} Jul 22 11:21:55.400398 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: method: Jul 22 11:21:55.400398 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 22 11:21:55.401363 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-768692611', 'metadata': {'Type': 'work'}}}} Jul 22 11:21:55.401363 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 22 11:21:55.401363 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:21:55.401363 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 22 11:21:55.401363 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 22 11:21:55.401363 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 22 11:21:55.401363 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise error Jul 22 11:21:55.401363 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 22 11:21:55.401363 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:21:55.401363 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 22 11:21:55.401363 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 22 11:21:55.401363 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:21:55.401363 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 22 11:21:55.401363 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi '' Jul 22 11:21:55.401363 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:21:55.401363 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:21:55.401363 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:21:55.401363 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:21:55.401363 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:21:55.401363 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:21:55.401363 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 22 11:21:55.401363 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 22 11:21:55.402961 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 22 11:21:55.402961 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 22 11:21:55.402961 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 22 11:21:55.402961 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 22 11:21:55.402961 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 22 11:21:55.402961 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 22 11:21:55.402961 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 22 11:21:55.402961 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 22 11:21:55.402961 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 22 11:21:55.402961 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 22 11:21:55.402961 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 22 11:21:55.402961 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:21:55.402961 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:21:55.402961 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:21:55.402961 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:21:55.402961 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:21:55.402961 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:21:55.402961 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 22 11:21:55.402961 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 22 11:21:55.405508 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 22 11:21:55.405508 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:21:55.405508 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-4be6fd22-bd33-4dd4-abb5-9c00085ae529 tempest-VolumesNegativeTest-1964132410 tempest-VolumesNegativeTest-1964132410-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 22 11:21:55.405508 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-4be6fd22-bd33-4dd4-abb5-9c00085ae529 tempest-VolumesNegativeTest-1964132410 tempest-VolumesNegativeTest-1964132410-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009329 Jul 22 11:21:55.405508 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 455/923] 10.222.0.20 () {60 vars in 1155 bytes} [Fri Jul 22 11:21:55 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 22 11:21:55.412074 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-06b42497-4c57-45c8-84e2-77ef553733bd tempest-VolumesNegativeTest-1964132410 tempest-VolumesNegativeTest-1964132410-project] Calling method '.version_select at 0x7f84451f19d0>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:55.442623 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.wsgi [None req-06b42497-4c57-45c8-84e2-77ef553733bd tempest-VolumesNegativeTest-1964132410 tempest-VolumesNegativeTest-1964132410-project] HTTP exception thrown: Volume tempest-invalid-383413252 could not be found. Jul 22 11:21:55.446101 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-06b42497-4c57-45c8-84e2-77ef553733bd tempest-VolumesNegativeTest-1964132410 tempest-VolumesNegativeTest-1964132410-project] Request method failure captured: Jul 22 11:21:55.446101 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-383413252 HTTP/1.1 Jul 22 11:21:55.446101 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Accept: application/json Jul 22 11:21:55.446101 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Accept-Encoding: identity Jul 22 11:21:55.446101 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Connection: close Jul 22 11:21:55.446101 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Content-Length: 0 Jul 22 11:21:55.446101 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Content-Type: application/json Jul 22 11:21:55.446101 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Host: 10.222.0.20 Jul 22 11:21:55.446101 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Openstack-System-Scope: None Jul 22 11:21:55.446101 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: User-Agent: python-urllib3/1.26.9 Jul 22 11:21:55.446101 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Auth-Token: gAAAAABi2ohTXRE9tHGlypYMqs47d-I3a6QN1PLP6tB1Zcg5cw31oqhU56s7z5ejOtaJ5B53-ofOnvcVHhfLNe6via8FJWD05Ow2Mwl0e8TsYSEaPLPTIaI5o3BVVAcsJwtT80P3RFAZQWD7lJbyHfB7vdAHdx0JnI2d1q75tSwE26T6bZ-ihsI Jul 22 11:21:55.446101 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Domain-Id: None Jul 22 11:21:55.446101 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Domain-Name: None Jul 22 11:21:55.446101 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Identity-Status: Confirmed Jul 22 11:21:55.446101 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Is-Admin-Project: True Jul 22 11:21:55.446101 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Project-Domain-Id: default Jul 22 11:21:55.446101 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Project-Domain-Name: Default Jul 22 11:21:55.446101 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Project-Id: 79c057e14b644edabf55e555d4a18b4b Jul 22 11:21:55.446101 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Project-Name: tempest-VolumesNegativeTest-1964132410 Jul 22 11:21:55.446101 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Role: reader,member Jul 22 11:21:55.446101 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Roles: reader,member Jul 22 11:21:55.447838 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/79c057e14b644edabf55e555d4a18b4b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_79c057e14b644edabf55e555d4a18b4b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/79c057e14b644edabf55e555d4a18b4b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/79c057e14b644edabf55e555d4a18b4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jul 22 11:21:55.447838 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Tenant: tempest-VolumesNegativeTest-1964132410 Jul 22 11:21:55.447838 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Tenant-Id: 79c057e14b644edabf55e555d4a18b4b Jul 22 11:21:55.447838 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Tenant-Name: tempest-VolumesNegativeTest-1964132410 Jul 22 11:21:55.447838 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User: tempest-VolumesNegativeTest-1964132410-project Jul 22 11:21:55.447838 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User-Domain-Id: default Jul 22 11:21:55.447838 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User-Domain-Name: Default Jul 22 11:21:55.447838 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User-Id: 86a14eb1c314449892281892a0f6bd7b Jul 22 11:21:55.447838 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User-Name: tempest-VolumesNegativeTest-1964132410-project Jul 22 11:21:55.447838 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: method: Jul 22 11:21:55.447838 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: exception: Volume tempest-invalid-383413252 could not be found. Jul 22 11:21:55.447838 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: action_args: {'id': 'tempest-invalid-383413252'} Jul 22 11:21:55.447838 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 22 11:21:55.448976 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:21:55.448976 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 22 11:21:55.448976 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 22 11:21:55.448976 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 22 11:21:55.448976 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 22 11:21:55.448976 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 22 11:21:55.448976 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 22 11:21:55.448976 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 22 11:21:55.448976 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 22 11:21:55.448976 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 22 11:21:55.448976 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 22 11:21:55.448976 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 22 11:21:55.448976 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 22 11:21:55.448976 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 22 11:21:55.448976 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 22 11:21:55.448976 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-383413252 could not be found. (HTTP 404) (Request-ID: req-0a88648b-1601-469a-afc1-63d268ca153a) Jul 22 11:21:55.448976 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:21:55.448976 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:21:55.448976 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:21:55.450411 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:21:55.450411 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 22 11:21:55.450411 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 22 11:21:55.450411 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 22 11:21:55.450411 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 22 11:21:55.450411 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 22 11:21:55.450411 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 22 11:21:55.450411 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 22 11:21:55.450411 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 22 11:21:55.450411 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 22 11:21:55.450411 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 22 11:21:55.450411 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 22 11:21:55.450411 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 22 11:21:55.450411 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 22 11:21:55.450411 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 22 11:21:55.450411 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 22 11:21:55.450411 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 22 11:21:55.450411 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 22 11:21:55.450411 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 22 11:21:55.451853 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 22 11:21:55.451853 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 22 11:21:55.451853 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 22 11:21:55.451853 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 22 11:21:55.451853 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-383413252 could not be found. Jul 22 11:21:55.451853 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:21:55.451853 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:21:55.451853 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:21:55.451853 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:21:55.451853 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:21:55.451853 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:21:55.451853 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 22 11:21:55.451853 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 22 11:21:55.451853 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 22 11:21:55.451853 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 22 11:21:55.451853 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 22 11:21:55.451853 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 22 11:21:55.451853 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 22 11:21:55.451853 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 22 11:21:55.451853 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-383413252 could not be found. Jul 22 11:21:55.453313 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:21:55.453313 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:21:55.453313 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:21:55.453313 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:21:55.453313 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:21:55.453313 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:21:55.453313 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 22 11:21:55.453313 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 22 11:21:55.453313 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-383413252 could not be found. Jul 22 11:21:55.453313 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:21:55.453313 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-06b42497-4c57-45c8-84e2-77ef553733bd tempest-VolumesNegativeTest-1964132410 tempest-VolumesNegativeTest-1964132410-project] Returning 404 to user: Volume tempest-invalid-383413252 could not be found. {{(pid=117885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 22 11:21:55.453313 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-06b42497-4c57-45c8-84e2-77ef553733bd tempest-VolumesNegativeTest-1964132410 tempest-VolumesNegativeTest-1964132410-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/tempest-invalid-383413252" status: 404 len: 98 microversion: 2.1 time: 0.040730 Jul 22 11:21:55.453313 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 469/924] 10.222.0.20 () {58 vars in 1214 bytes} [Fri Jul 22 11:21:55 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-383413252 => generated 98 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 22 11:21:55.457725 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-a7de321d-d493-4441-9c4a-e877ea43318e tempest-VolumesNegativeTest-1964132410 tempest-VolumesNegativeTest-1964132410-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004256 Jul 22 11:21:55.458192 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 456/925] 10.222.0.20 () {58 vars in 1139 bytes} [Fri Jul 22 11:21:55 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 22 11:21:55.467213 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-f0a8d15a-f091-4d5e-af46-50981f31130e tempest-VolumesNegativeTest-1964132410 tempest-VolumesNegativeTest-1964132410-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004091 Jul 22 11:21:55.467826 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 470/926] 10.222.0.20 () {58 vars in 1136 bytes} [Fri Jul 22 11:21:55 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jul 22 11:21:55.477243 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-34118fe3-8800-4889-8fa1-a405deab095a tempest-VolumesNegativeTest-1964132410 tempest-VolumesNegativeTest-1964132410-project] Calling method '.version_select at 0x7f84450c70d0>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:55.509269 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.wsgi [None req-34118fe3-8800-4889-8fa1-a405deab095a tempest-VolumesNegativeTest-1964132410 tempest-VolumesNegativeTest-1964132410-project] HTTP exception thrown: Volume 09878dbb-2ab0-48db-8a9f-bc55e2e33f4d could not be found. Jul 22 11:21:55.511250 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-34118fe3-8800-4889-8fa1-a405deab095a tempest-VolumesNegativeTest-1964132410 tempest-VolumesNegativeTest-1964132410-project] Request method failure captured: Jul 22 11:21:55.511250 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: request: DELETE /compute/v2.1/os-volumes/09878dbb-2ab0-48db-8a9f-bc55e2e33f4d HTTP/1.1 Jul 22 11:21:55.511250 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Accept: application/json Jul 22 11:21:55.511250 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Accept-Encoding: identity Jul 22 11:21:55.511250 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Connection: close Jul 22 11:21:55.511250 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Content-Length: 0 Jul 22 11:21:55.511250 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Content-Type: application/json Jul 22 11:21:55.511250 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Host: 10.222.0.20 Jul 22 11:21:55.511250 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Openstack-System-Scope: None Jul 22 11:21:55.511250 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: User-Agent: python-urllib3/1.26.9 Jul 22 11:21:55.511250 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Auth-Token: gAAAAABi2ohTXRE9tHGlypYMqs47d-I3a6QN1PLP6tB1Zcg5cw31oqhU56s7z5ejOtaJ5B53-ofOnvcVHhfLNe6via8FJWD05Ow2Mwl0e8TsYSEaPLPTIaI5o3BVVAcsJwtT80P3RFAZQWD7lJbyHfB7vdAHdx0JnI2d1q75tSwE26T6bZ-ihsI Jul 22 11:21:55.511250 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Domain-Id: None Jul 22 11:21:55.511250 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Domain-Name: None Jul 22 11:21:55.511250 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Identity-Status: Confirmed Jul 22 11:21:55.511250 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Is-Admin-Project: True Jul 22 11:21:55.511250 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Domain-Id: default Jul 22 11:21:55.511250 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Domain-Name: Default Jul 22 11:21:55.511250 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Id: 79c057e14b644edabf55e555d4a18b4b Jul 22 11:21:55.511250 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Name: tempest-VolumesNegativeTest-1964132410 Jul 22 11:21:55.511250 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Role: reader,member Jul 22 11:21:55.511250 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Roles: reader,member Jul 22 11:21:55.512859 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/79c057e14b644edabf55e555d4a18b4b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_79c057e14b644edabf55e555d4a18b4b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/79c057e14b644edabf55e555d4a18b4b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/79c057e14b644edabf55e555d4a18b4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jul 22 11:21:55.512859 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant: tempest-VolumesNegativeTest-1964132410 Jul 22 11:21:55.512859 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant-Id: 79c057e14b644edabf55e555d4a18b4b Jul 22 11:21:55.512859 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant-Name: tempest-VolumesNegativeTest-1964132410 Jul 22 11:21:55.512859 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User: tempest-VolumesNegativeTest-1964132410-project Jul 22 11:21:55.512859 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Domain-Id: default Jul 22 11:21:55.512859 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Domain-Name: Default Jul 22 11:21:55.512859 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Id: 86a14eb1c314449892281892a0f6bd7b Jul 22 11:21:55.512859 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Name: tempest-VolumesNegativeTest-1964132410-project Jul 22 11:21:55.512859 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: method: Jul 22 11:21:55.512859 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: exception: Volume 09878dbb-2ab0-48db-8a9f-bc55e2e33f4d could not be found. Jul 22 11:21:55.512859 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: action_args: {'id': '09878dbb-2ab0-48db-8a9f-bc55e2e33f4d'} Jul 22 11:21:55.512859 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 22 11:21:55.513772 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:21:55.513772 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 22 11:21:55.513772 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 22 11:21:55.513772 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 22 11:21:55.513772 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 22 11:21:55.513772 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 22 11:21:55.513772 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 22 11:21:55.513772 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 22 11:21:55.513772 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 22 11:21:55.513772 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 22 11:21:55.513772 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 22 11:21:55.513772 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 22 11:21:55.513772 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 22 11:21:55.513772 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 22 11:21:55.513772 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 22 11:21:55.513772 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 09878dbb-2ab0-48db-8a9f-bc55e2e33f4d could not be found. (HTTP 404) (Request-ID: req-55b617be-ccfa-4876-a5ed-1b38425c68db) Jul 22 11:21:55.513772 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:21:55.513772 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:21:55.513772 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:21:55.515087 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:21:55.515087 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 22 11:21:55.515087 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 22 11:21:55.515087 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 22 11:21:55.515087 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 22 11:21:55.515087 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 22 11:21:55.515087 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 22 11:21:55.515087 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 22 11:21:55.515087 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 22 11:21:55.515087 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 22 11:21:55.515087 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 22 11:21:55.515087 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 22 11:21:55.515087 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 22 11:21:55.515087 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 22 11:21:55.515087 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 22 11:21:55.515087 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 22 11:21:55.515087 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 22 11:21:55.515087 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 22 11:21:55.515087 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 22 11:21:55.516491 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 22 11:21:55.516491 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 22 11:21:55.516491 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 22 11:21:55.516491 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 22 11:21:55.516491 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 09878dbb-2ab0-48db-8a9f-bc55e2e33f4d could not be found. Jul 22 11:21:55.516491 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:21:55.516491 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:21:55.516491 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:21:55.516491 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:21:55.516491 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:21:55.516491 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:21:55.516491 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 22 11:21:55.516491 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 22 11:21:55.516491 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 22 11:21:55.516491 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 22 11:21:55.516491 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 22 11:21:55.516491 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 22 11:21:55.516491 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 22 11:21:55.516491 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 22 11:21:55.518263 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 09878dbb-2ab0-48db-8a9f-bc55e2e33f4d could not be found. Jul 22 11:21:55.518263 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:21:55.518263 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:21:55.518263 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:21:55.518263 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:21:55.518263 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:21:55.518263 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:21:55.518263 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 22 11:21:55.518263 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 22 11:21:55.518263 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 09878dbb-2ab0-48db-8a9f-bc55e2e33f4d could not be found. Jul 22 11:21:55.518263 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:21:55.518263 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-34118fe3-8800-4889-8fa1-a405deab095a tempest-VolumesNegativeTest-1964132410 tempest-VolumesNegativeTest-1964132410-project] Returning 404 to user: Volume 09878dbb-2ab0-48db-8a9f-bc55e2e33f4d could not be found. {{(pid=117884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 22 11:21:55.518263 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-34118fe3-8800-4889-8fa1-a405deab095a tempest-VolumesNegativeTest-1964132410 tempest-VolumesNegativeTest-1964132410-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/09878dbb-2ab0-48db-8a9f-bc55e2e33f4d" status: 404 len: 109 microversion: 2.1 time: 0.039360 Jul 22 11:21:55.518263 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 457/927] 10.222.0.20 () {58 vars in 1247 bytes} [Fri Jul 22 11:21:55 2022] DELETE /compute/v2.1/os-volumes/09878dbb-2ab0-48db-8a9f-bc55e2e33f4d => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 22 11:21:55.524427 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-28199ce6-ebd4-47e2-95ff-403f8647dacc tempest-VolumesNegativeTest-1964132410 tempest-VolumesNegativeTest-1964132410-project] Calling method '.version_select at 0x7f84451df280>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:55.553255 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.wsgi [None req-28199ce6-ebd4-47e2-95ff-403f8647dacc tempest-VolumesNegativeTest-1964132410 tempest-VolumesNegativeTest-1964132410-project] HTTP exception thrown: Volume f1631eab-1402-484a-ab0f-df4d959f7817 could not be found. Jul 22 11:21:55.556074 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-28199ce6-ebd4-47e2-95ff-403f8647dacc tempest-VolumesNegativeTest-1964132410 tempest-VolumesNegativeTest-1964132410-project] Request method failure captured: Jul 22 11:21:55.556074 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: request: GET /compute/v2.1/os-volumes/f1631eab-1402-484a-ab0f-df4d959f7817 HTTP/1.1 Jul 22 11:21:55.556074 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Accept: application/json Jul 22 11:21:55.556074 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Accept-Encoding: identity Jul 22 11:21:55.556074 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Connection: close Jul 22 11:21:55.556074 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Content-Length: 0 Jul 22 11:21:55.556074 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Content-Type: application/json Jul 22 11:21:55.556074 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Host: 10.222.0.20 Jul 22 11:21:55.556074 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Openstack-System-Scope: None Jul 22 11:21:55.556074 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: User-Agent: python-urllib3/1.26.9 Jul 22 11:21:55.556074 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Auth-Token: gAAAAABi2ohTXRE9tHGlypYMqs47d-I3a6QN1PLP6tB1Zcg5cw31oqhU56s7z5ejOtaJ5B53-ofOnvcVHhfLNe6via8FJWD05Ow2Mwl0e8TsYSEaPLPTIaI5o3BVVAcsJwtT80P3RFAZQWD7lJbyHfB7vdAHdx0JnI2d1q75tSwE26T6bZ-ihsI Jul 22 11:21:55.556074 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Domain-Id: None Jul 22 11:21:55.556074 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Domain-Name: None Jul 22 11:21:55.556074 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Identity-Status: Confirmed Jul 22 11:21:55.556074 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Is-Admin-Project: True Jul 22 11:21:55.556074 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Project-Domain-Id: default Jul 22 11:21:55.556074 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Project-Domain-Name: Default Jul 22 11:21:55.556074 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Project-Id: 79c057e14b644edabf55e555d4a18b4b Jul 22 11:21:55.556074 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Project-Name: tempest-VolumesNegativeTest-1964132410 Jul 22 11:21:55.556074 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Role: reader,member Jul 22 11:21:55.556074 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Roles: reader,member Jul 22 11:21:55.557645 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/79c057e14b644edabf55e555d4a18b4b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_79c057e14b644edabf55e555d4a18b4b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/79c057e14b644edabf55e555d4a18b4b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/79c057e14b644edabf55e555d4a18b4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jul 22 11:21:55.557645 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Tenant: tempest-VolumesNegativeTest-1964132410 Jul 22 11:21:55.557645 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Tenant-Id: 79c057e14b644edabf55e555d4a18b4b Jul 22 11:21:55.557645 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Tenant-Name: tempest-VolumesNegativeTest-1964132410 Jul 22 11:21:55.557645 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User: tempest-VolumesNegativeTest-1964132410-project Jul 22 11:21:55.557645 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User-Domain-Id: default Jul 22 11:21:55.557645 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User-Domain-Name: Default Jul 22 11:21:55.557645 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User-Id: 86a14eb1c314449892281892a0f6bd7b Jul 22 11:21:55.557645 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User-Name: tempest-VolumesNegativeTest-1964132410-project Jul 22 11:21:55.557645 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: method: Jul 22 11:21:55.557645 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: exception: Volume f1631eab-1402-484a-ab0f-df4d959f7817 could not be found. Jul 22 11:21:55.557645 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: action_args: {'id': 'f1631eab-1402-484a-ab0f-df4d959f7817'} Jul 22 11:21:55.557645 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 22 11:21:55.558548 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:21:55.558548 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 22 11:21:55.558548 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 22 11:21:55.558548 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 22 11:21:55.558548 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 22 11:21:55.558548 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 22 11:21:55.558548 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 22 11:21:55.558548 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 22 11:21:55.558548 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 22 11:21:55.558548 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 22 11:21:55.558548 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 22 11:21:55.558548 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 22 11:21:55.558548 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 22 11:21:55.558548 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 22 11:21:55.558548 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 22 11:21:55.558548 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f1631eab-1402-484a-ab0f-df4d959f7817 could not be found. (HTTP 404) (Request-ID: req-0428b174-45ea-4d09-a6a0-4cba6b08deae) Jul 22 11:21:55.558548 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:21:55.558548 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:21:55.558548 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:21:55.559960 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:21:55.559960 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 22 11:21:55.559960 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 22 11:21:55.559960 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 22 11:21:55.559960 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 22 11:21:55.559960 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 22 11:21:55.559960 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 22 11:21:55.559960 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 22 11:21:55.559960 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 22 11:21:55.559960 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 22 11:21:55.559960 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 22 11:21:55.559960 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 22 11:21:55.559960 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 22 11:21:55.559960 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 22 11:21:55.559960 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 22 11:21:55.559960 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 22 11:21:55.559960 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 22 11:21:55.559960 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 22 11:21:55.559960 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 22 11:21:55.561380 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 22 11:21:55.561380 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 22 11:21:55.561380 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 22 11:21:55.561380 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 22 11:21:55.561380 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f1631eab-1402-484a-ab0f-df4d959f7817 could not be found. Jul 22 11:21:55.561380 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:21:55.561380 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:21:55.561380 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:21:55.561380 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:21:55.561380 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:21:55.561380 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:21:55.561380 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 22 11:21:55.561380 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 22 11:21:55.561380 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 22 11:21:55.561380 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 22 11:21:55.561380 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 22 11:21:55.561380 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 22 11:21:55.561380 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 22 11:21:55.561380 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 22 11:21:55.562848 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f1631eab-1402-484a-ab0f-df4d959f7817 could not be found. Jul 22 11:21:55.562848 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:21:55.562848 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:21:55.562848 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:21:55.562848 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:21:55.562848 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:21:55.562848 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:21:55.562848 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 22 11:21:55.562848 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 22 11:21:55.562848 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f1631eab-1402-484a-ab0f-df4d959f7817 could not be found. Jul 22 11:21:55.562848 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:21:55.562848 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-28199ce6-ebd4-47e2-95ff-403f8647dacc tempest-VolumesNegativeTest-1964132410 tempest-VolumesNegativeTest-1964132410-project] Returning 404 to user: Volume f1631eab-1402-484a-ab0f-df4d959f7817 could not be found. {{(pid=117885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 22 11:21:55.562848 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-28199ce6-ebd4-47e2-95ff-403f8647dacc tempest-VolumesNegativeTest-1964132410 tempest-VolumesNegativeTest-1964132410-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/f1631eab-1402-484a-ab0f-df4d959f7817" status: 404 len: 109 microversion: 2.1 time: 0.037205 Jul 22 11:21:55.562848 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 471/928] 10.222.0.20 () {58 vars in 1244 bytes} [Fri Jul 22 11:21:55 2022] GET /compute/v2.1/os-volumes/f1631eab-1402-484a-ab0f-df4d959f7817 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 22 11:21:55.620121 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-67f1e2cd-ef05-4214-8d2b-2e7acfe898b5 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:55.620811 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-67f1e2cd-ef05-4214-8d2b-2e7acfe898b5 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:55.627036 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-67f1e2cd-ef05-4214-8d2b-2e7acfe898b5 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:55.627530 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-67f1e2cd-ef05-4214-8d2b-2e7acfe898b5 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:55.628300 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-67f1e2cd-ef05-4214-8d2b-2e7acfe898b5 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:55.628726 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-67f1e2cd-ef05-4214-8d2b-2e7acfe898b5 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:55.764889 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-67f1e2cd-ef05-4214-8d2b-2e7acfe898b5 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:55.773231 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-67f1e2cd-ef05-4214-8d2b-2e7acfe898b5 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:55.774720 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-67f1e2cd-ef05-4214-8d2b-2e7acfe898b5 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:55.775890 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-67f1e2cd-ef05-4214-8d2b-2e7acfe898b5 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46" status: 200 len: 1731 microversion: 2.20 time: 0.159858 Jul 22 11:21:55.776438 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 458/929] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:21:55 2022] GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:21:56.384961 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-31b21469-1c0b-4eeb-8eb3-eefa05eb162d tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:56.386366 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-31b21469-1c0b-4eeb-8eb3-eefa05eb162d tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] [instance: 36dec2db-4166-4853-a79b-832ad7fc2730] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:56.394322 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-31b21469-1c0b-4eeb-8eb3-eefa05eb162d tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:56.394780 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-31b21469-1c0b-4eeb-8eb3-eefa05eb162d tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:56.395845 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-31b21469-1c0b-4eeb-8eb3-eefa05eb162d tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:56.396289 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-31b21469-1c0b-4eeb-8eb3-eefa05eb162d tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:56.551177 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-31b21469-1c0b-4eeb-8eb3-eefa05eb162d tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a299663b56b411b9fc910ddf47103e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d58bceb8414b02a1bbaec0db07d85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:56.553602 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:21:56.561137 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-31b21469-1c0b-4eeb-8eb3-eefa05eb162d tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] 10.222.0.20 "GET /compute/v2.1/servers/36dec2db-4166-4853-a79b-832ad7fc2730" status: 200 len: 1266 microversion: 2.1 time: 0.180105 Jul 22 11:21:56.561935 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 472/930] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:21:56 2022] GET /compute/v2.1/servers/36dec2db-4166-4853-a79b-832ad7fc2730 => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:21:56.797178 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-265851a2-86b0-4893-98c3-6a9300134286 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:56.798861 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-265851a2-86b0-4893-98c3-6a9300134286 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:56.806440 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-265851a2-86b0-4893-98c3-6a9300134286 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:56.807146 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-265851a2-86b0-4893-98c3-6a9300134286 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:56.808360 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-265851a2-86b0-4893-98c3-6a9300134286 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:56.808797 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-265851a2-86b0-4893-98c3-6a9300134286 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:56.974464 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-265851a2-86b0-4893-98c3-6a9300134286 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:56.985039 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-265851a2-86b0-4893-98c3-6a9300134286 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:56.987537 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-265851a2-86b0-4893-98c3-6a9300134286 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:56.989085 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-265851a2-86b0-4893-98c3-6a9300134286 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46" status: 200 len: 1731 microversion: 2.20 time: 0.198413 Jul 22 11:21:56.990078 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 459/931] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:21:56 2022] GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 => generated 1731 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:21:57.583230 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-75188556-543b-42c5-ab75-02b259e845fa tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:57.584137 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-75188556-543b-42c5-ab75-02b259e845fa tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] [instance: 36dec2db-4166-4853-a79b-832ad7fc2730] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:57.592422 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-75188556-543b-42c5-ab75-02b259e845fa tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:57.593156 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-75188556-543b-42c5-ab75-02b259e845fa tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:57.594329 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-75188556-543b-42c5-ab75-02b259e845fa tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:57.595545 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-75188556-543b-42c5-ab75-02b259e845fa tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:57.788323 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-75188556-543b-42c5-ab75-02b259e845fa tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a299663b56b411b9fc910ddf47103e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d58bceb8414b02a1bbaec0db07d85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:57.796178 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-75188556-543b-42c5-ab75-02b259e845fa tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] 10.222.0.20 "GET /compute/v2.1/servers/36dec2db-4166-4853-a79b-832ad7fc2730" status: 200 len: 1266 microversion: 2.1 time: 0.218682 Jul 22 11:21:57.796908 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 473/932] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:21:57 2022] GET /compute/v2.1/servers/36dec2db-4166-4853-a79b-832ad7fc2730 => generated 1266 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:21:58.008350 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-b75e1a00-aaa2-477b-a6d7-3859d3dfa3ac tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:58.009738 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-b75e1a00-aaa2-477b-a6d7-3859d3dfa3ac tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:58.017496 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-b75e1a00-aaa2-477b-a6d7-3859d3dfa3ac tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:58.018007 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-b75e1a00-aaa2-477b-a6d7-3859d3dfa3ac tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:58.018863 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-b75e1a00-aaa2-477b-a6d7-3859d3dfa3ac tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:58.019390 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-b75e1a00-aaa2-477b-a6d7-3859d3dfa3ac tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:58.196120 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-b75e1a00-aaa2-477b-a6d7-3859d3dfa3ac tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:58.206695 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-b75e1a00-aaa2-477b-a6d7-3859d3dfa3ac tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:58.208335 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-b75e1a00-aaa2-477b-a6d7-3859d3dfa3ac tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:58.209912 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-b75e1a00-aaa2-477b-a6d7-3859d3dfa3ac tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46" status: 200 len: 1731 microversion: 2.20 time: 0.205794 Jul 22 11:21:58.210686 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 460/933] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:21:58 2022] GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 => generated 1731 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:21:58.391831 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-c0d02eaf-c5bb-45fc-b158-d1e662c7b005 req-71d9e695-96d2-42b0-89ee-816caba34407 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46", "name": "network-vif-plugged", "status": "completed", "tag": "c1ac6e13-743e-4cd7-b970-2f05998ba958"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:21:58.407702 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-c0d02eaf-c5bb-45fc-b158-d1e662c7b005 req-71d9e695-96d2-42b0-89ee-816caba34407 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:58.412715 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-c0d02eaf-c5bb-45fc-b158-d1e662c7b005 req-71d9e695-96d2-42b0-89ee-816caba34407 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:58.448131 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-c0d02eaf-c5bb-45fc-b158-d1e662c7b005 req-71d9e695-96d2-42b0-89ee-816caba34407 service nova] Creating event network-vif-plugged:c1ac6e13-743e-4cd7-b970-2f05998ba958 for instance f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 on hv-cinder-84890 Jul 22 11:21:58.462449 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-c0d02eaf-c5bb-45fc-b158-d1e662c7b005 req-71d9e695-96d2-42b0-89ee-816caba34407 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067796 Jul 22 11:21:58.466144 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 474/934] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:21:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:21:58.819151 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-3ddb472f-bd79-4997-98a9-63c0166ad76d tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:58.819971 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-3ddb472f-bd79-4997-98a9-63c0166ad76d tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] [instance: 36dec2db-4166-4853-a79b-832ad7fc2730] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:58.827625 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-3ddb472f-bd79-4997-98a9-63c0166ad76d tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:58.828508 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-3ddb472f-bd79-4997-98a9-63c0166ad76d tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:58.830019 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-3ddb472f-bd79-4997-98a9-63c0166ad76d tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:58.830469 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-3ddb472f-bd79-4997-98a9-63c0166ad76d tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:59.101417 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-3ddb472f-bd79-4997-98a9-63c0166ad76d tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a299663b56b411b9fc910ddf47103e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d58bceb8414b02a1bbaec0db07d85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:59.115387 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-3ddb472f-bd79-4997-98a9-63c0166ad76d tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] 10.222.0.20 "GET /compute/v2.1/servers/36dec2db-4166-4853-a79b-832ad7fc2730" status: 200 len: 1266 microversion: 2.1 time: 0.300573 Jul 22 11:21:59.116603 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 461/935] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:21:58 2022] GET /compute/v2.1/servers/36dec2db-4166-4853-a79b-832ad7fc2730 => generated 1266 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:21:59.233782 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-62cc6295-d956-497a-9c3b-c005c75b8f5d tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:21:59.234780 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-62cc6295-d956-497a-9c3b-c005c75b8f5d tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:21:59.249045 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-62cc6295-d956-497a-9c3b-c005c75b8f5d tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:59.249579 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-62cc6295-d956-497a-9c3b-c005c75b8f5d tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:59.250488 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-62cc6295-d956-497a-9c3b-c005c75b8f5d tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:21:59.251771 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-62cc6295-d956-497a-9c3b-c005c75b8f5d tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:21:59.432427 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-62cc6295-d956-497a-9c3b-c005c75b8f5d tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:59.443675 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-62cc6295-d956-497a-9c3b-c005c75b8f5d tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:59.444920 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-62cc6295-d956-497a-9c3b-c005c75b8f5d tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:21:59.446474 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-62cc6295-d956-497a-9c3b-c005c75b8f5d tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46" status: 200 len: 1731 microversion: 2.20 time: 0.218549 Jul 22 11:21:59.447739 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 475/936] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:21:59 2022] GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 => generated 1731 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:22:00.133603 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-8bc3367e-11d6-4f14-bf08-3533facddb23 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:22:00.134704 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-8bc3367e-11d6-4f14-bf08-3533facddb23 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] [instance: 36dec2db-4166-4853-a79b-832ad7fc2730] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:22:00.142194 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-8bc3367e-11d6-4f14-bf08-3533facddb23 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:00.142646 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-8bc3367e-11d6-4f14-bf08-3533facddb23 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:00.143629 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-8bc3367e-11d6-4f14-bf08-3533facddb23 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:00.144363 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-8bc3367e-11d6-4f14-bf08-3533facddb23 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:00.321812 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-8bc3367e-11d6-4f14-bf08-3533facddb23 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a299663b56b411b9fc910ddf47103e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d58bceb8414b02a1bbaec0db07d85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:22:00.333296 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-8bc3367e-11d6-4f14-bf08-3533facddb23 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] 10.222.0.20 "GET /compute/v2.1/servers/36dec2db-4166-4853-a79b-832ad7fc2730" status: 200 len: 1266 microversion: 2.1 time: 0.203762 Jul 22 11:22:00.334030 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 462/937] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:22:00 2022] GET /compute/v2.1/servers/36dec2db-4166-4853-a79b-832ad7fc2730 => generated 1266 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:22:00.470349 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-c1cbfe83-298c-4f08-b9f9-a3c6bca4f825 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:22:00.473032 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-c1cbfe83-298c-4f08-b9f9-a3c6bca4f825 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:22:00.482282 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c1cbfe83-298c-4f08-b9f9-a3c6bca4f825 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:00.482772 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c1cbfe83-298c-4f08-b9f9-a3c6bca4f825 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:00.483791 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c1cbfe83-298c-4f08-b9f9-a3c6bca4f825 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:00.484421 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c1cbfe83-298c-4f08-b9f9-a3c6bca4f825 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:00.510937 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [req-52fb03a6-9c79-4696-be32-02a6b4c8178b req-41b5ef7a-7723-46b1-b9cc-9cfe088778f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36dec2db-4166-4853-a79b-832ad7fc2730", "name": "network-vif-plugged", "status": "completed", "tag": "de8e5933-745f-42ff-8fcb-dde4aff354a3"}]} {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:22:00.520578 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-52fb03a6-9c79-4696-be32-02a6b4c8178b req-41b5ef7a-7723-46b1-b9cc-9cfe088778f0 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:00.521118 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-52fb03a6-9c79-4696-be32-02a6b4c8178b req-41b5ef7a-7723-46b1-b9cc-9cfe088778f0 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:00.537643 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.compute.server_external_events [req-52fb03a6-9c79-4696-be32-02a6b4c8178b req-41b5ef7a-7723-46b1-b9cc-9cfe088778f0 service nova] Creating event network-vif-plugged:de8e5933-745f-42ff-8fcb-dde4aff354a3 for instance 36dec2db-4166-4853-a79b-832ad7fc2730 on hv-cinder-84890 Jul 22 11:22:00.546543 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [req-52fb03a6-9c79-4696-be32-02a6b4c8178b req-41b5ef7a-7723-46b1-b9cc-9cfe088778f0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038773 Jul 22 11:22:00.548392 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 463/938] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:22:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 22 11:22:00.714671 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-c1cbfe83-298c-4f08-b9f9-a3c6bca4f825 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:22:00.727726 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-c1cbfe83-298c-4f08-b9f9-a3c6bca4f825 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:22:00.730684 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-c1cbfe83-298c-4f08-b9f9-a3c6bca4f825 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:22:00.732071 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-c1cbfe83-298c-4f08-b9f9-a3c6bca4f825 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46" status: 200 len: 1731 microversion: 2.20 time: 0.267477 Jul 22 11:22:00.733283 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 476/939] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:22:00 2022] GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 => generated 1731 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:22:01.357227 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-f9bba6a2-6cf7-4af0-bd2c-1c141655d863 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:22:01.358053 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-f9bba6a2-6cf7-4af0-bd2c-1c141655d863 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] [instance: 36dec2db-4166-4853-a79b-832ad7fc2730] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:22:01.367729 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f9bba6a2-6cf7-4af0-bd2c-1c141655d863 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:01.368504 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f9bba6a2-6cf7-4af0-bd2c-1c141655d863 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:01.370093 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f9bba6a2-6cf7-4af0-bd2c-1c141655d863 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:01.370773 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f9bba6a2-6cf7-4af0-bd2c-1c141655d863 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:01.582738 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-f9bba6a2-6cf7-4af0-bd2c-1c141655d863 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a299663b56b411b9fc910ddf47103e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d58bceb8414b02a1bbaec0db07d85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:22:01.599718 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-f9bba6a2-6cf7-4af0-bd2c-1c141655d863 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] 10.222.0.20 "GET /compute/v2.1/servers/36dec2db-4166-4853-a79b-832ad7fc2730" status: 200 len: 1266 microversion: 2.1 time: 0.251385 Jul 22 11:22:01.601500 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 464/940] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:22:01 2022] GET /compute/v2.1/servers/36dec2db-4166-4853-a79b-832ad7fc2730 => generated 1266 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:22:01.755197 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-e3c69300-7bde-466d-ab1e-60eb5ce7b1bd tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:22:01.756197 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-e3c69300-7bde-466d-ab1e-60eb5ce7b1bd tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:22:01.763200 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e3c69300-7bde-466d-ab1e-60eb5ce7b1bd tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:01.763871 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e3c69300-7bde-466d-ab1e-60eb5ce7b1bd tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:01.764713 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e3c69300-7bde-466d-ab1e-60eb5ce7b1bd tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:01.765365 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e3c69300-7bde-466d-ab1e-60eb5ce7b1bd tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:01.995282 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-e3c69300-7bde-466d-ab1e-60eb5ce7b1bd tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:22:02.015238 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-e3c69300-7bde-466d-ab1e-60eb5ce7b1bd tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:22:02.019066 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-e3c69300-7bde-466d-ab1e-60eb5ce7b1bd tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:22:02.020324 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-e3c69300-7bde-466d-ab1e-60eb5ce7b1bd tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46" status: 200 len: 1731 microversion: 2.20 time: 0.273727 Jul 22 11:22:02.021902 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 477/941] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:22:01 2022] GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 => generated 1731 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:22:02.618648 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-20225d43-6873-443a-bb59-e05bf40978ca tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:22:02.619284 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-20225d43-6873-443a-bb59-e05bf40978ca tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] [instance: 36dec2db-4166-4853-a79b-832ad7fc2730] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:22:02.626793 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-20225d43-6873-443a-bb59-e05bf40978ca tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:02.628634 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-20225d43-6873-443a-bb59-e05bf40978ca tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:02.629603 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-20225d43-6873-443a-bb59-e05bf40978ca tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:02.630458 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-20225d43-6873-443a-bb59-e05bf40978ca tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:02.818370 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-20225d43-6873-443a-bb59-e05bf40978ca tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a299663b56b411b9fc910ddf47103e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d58bceb8414b02a1bbaec0db07d85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:22:02.830318 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-20225d43-6873-443a-bb59-e05bf40978ca tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] 10.222.0.20 "GET /compute/v2.1/servers/36dec2db-4166-4853-a79b-832ad7fc2730" status: 200 len: 1453 microversion: 2.1 time: 0.215775 Jul 22 11:22:02.833006 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 465/942] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:22:02 2022] GET /compute/v2.1/servers/36dec2db-4166-4853-a79b-832ad7fc2730 => generated 1453 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:22:02.849411 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-cd25303b-f14b-40bc-80e1-a150a775cbdf tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:22:02.850734 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-cd25303b-f14b-40bc-80e1-a150a775cbdf tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] [instance: 36dec2db-4166-4853-a79b-832ad7fc2730] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:22:02.856904 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-cd25303b-f14b-40bc-80e1-a150a775cbdf tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:02.857349 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-cd25303b-f14b-40bc-80e1-a150a775cbdf tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:02.858362 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-cd25303b-f14b-40bc-80e1-a150a775cbdf tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:02.858963 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-cd25303b-f14b-40bc-80e1-a150a775cbdf tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:03.006999 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-cd25303b-f14b-40bc-80e1-a150a775cbdf tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a299663b56b411b9fc910ddf47103e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d58bceb8414b02a1bbaec0db07d85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:22:03.014571 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-cd25303b-f14b-40bc-80e1-a150a775cbdf tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] 10.222.0.20 "GET /compute/v2.1/servers/36dec2db-4166-4853-a79b-832ad7fc2730" status: 200 len: 1453 microversion: 2.1 time: 0.171222 Jul 22 11:22:03.015154 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 478/943] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:22:02 2022] GET /compute/v2.1/servers/36dec2db-4166-4853-a79b-832ad7fc2730 => generated 1453 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:22:03.044409 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-4ad50d96-d094-4134-b889-591824df65f4 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:22:03.045120 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-4ad50d96-d094-4134-b889-591824df65f4 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:22:03.051350 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-4ad50d96-d094-4134-b889-591824df65f4 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:03.051748 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-4ad50d96-d094-4134-b889-591824df65f4 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:03.052547 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-4ad50d96-d094-4134-b889-591824df65f4 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:03.053205 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-4ad50d96-d094-4134-b889-591824df65f4 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:03.220955 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-4ad50d96-d094-4134-b889-591824df65f4 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:22:03.231603 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-4ad50d96-d094-4134-b889-591824df65f4 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:22:03.234251 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-4ad50d96-d094-4134-b889-591824df65f4 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:22:03.235983 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-4ad50d96-d094-4134-b889-591824df65f4 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46" status: 200 len: 1718 microversion: 2.20 time: 0.195989 Jul 22 11:22:03.237026 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 466/944] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:22:03 2022] GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 => generated 1718 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:22:05.323922 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-ad6bf876-da5f-45c4-a249-f70b9fc2bf3a req-673d95fa-3a50-43a6-955b-7e336a7eb579 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36dec2db-4166-4853-a79b-832ad7fc2730", "tag": "de8e5933-745f-42ff-8fcb-dde4aff354a3"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:22:05.333135 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-ad6bf876-da5f-45c4-a249-f70b9fc2bf3a req-673d95fa-3a50-43a6-955b-7e336a7eb579 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:05.333573 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-ad6bf876-da5f-45c4-a249-f70b9fc2bf3a req-673d95fa-3a50-43a6-955b-7e336a7eb579 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:05.349783 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-ad6bf876-da5f-45c4-a249-f70b9fc2bf3a req-673d95fa-3a50-43a6-955b-7e336a7eb579 service nova] Creating event network-changed:de8e5933-745f-42ff-8fcb-dde4aff354a3 for instance 36dec2db-4166-4853-a79b-832ad7fc2730 on hv-cinder-84890 Jul 22 11:22:05.355090 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-ad6bf876-da5f-45c4-a249-f70b9fc2bf3a req-673d95fa-3a50-43a6-955b-7e336a7eb579 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034876 Jul 22 11:22:05.356056 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 479/945] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:22:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:22:18.325953 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-a257a942-af1b-4d7d-a880-1ad4e164d3de tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2129143787", "imageRef": "1a6c3cb4-9f56-44c6-aa68-01000df27209", "flavorRef": "452", "networks": [{"uuid": "0bb40272-eb7c-4bea-bfbf-46a5f3fdcf2c"}]}} {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:22:18.335022 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG dbcounter [-] [117884] Writing DB stats nova_api:SELECT=23 {{(pid=117884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:22:18.335697 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG dbcounter [-] [117884] Writing DB stats nova_cell1:SELECT=64 {{(pid=117884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:22:18.383983 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.network.neutron [None req-a257a942-af1b-4d7d-a880-1ad4e164d3de tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] validate_networks() for [('0bb40272-eb7c-4bea-bfbf-46a5f3fdcf2c', None, None, None, None, None)] {{(pid=117884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 22 11:22:18.766614 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.virt.hardware [None req-a257a942-af1b-4d7d-a880-1ad4e164d3de tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Flavor limits 0:0:0 {{(pid=117884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 22 11:22:18.767038 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.virt.hardware [None req-a257a942-af1b-4d7d-a880-1ad4e164d3de tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Image limits 0:0:0 {{(pid=117884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 22 11:22:18.767570 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.virt.hardware [None req-a257a942-af1b-4d7d-a880-1ad4e164d3de tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Flavor pref 0:0:0 {{(pid=117884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 22 11:22:18.767974 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.virt.hardware [None req-a257a942-af1b-4d7d-a880-1ad4e164d3de tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Image pref 0:0:0 {{(pid=117884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 22 11:22:18.769703 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.virt.hardware [None req-a257a942-af1b-4d7d-a880-1ad4e164d3de tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 22 11:22:18.791087 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-a257a942-af1b-4d7d-a880-1ad4e164d3de tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:18.791792 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-a257a942-af1b-4d7d-a880-1ad4e164d3de tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:18.792604 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-a257a942-af1b-4d7d-a880-1ad4e164d3de tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:18.793038 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-a257a942-af1b-4d7d-a880-1ad4e164d3de tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:18.817776 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.quota [None req-a257a942-af1b-4d7d-a880-1ad4e164d3de tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Getting quotas for project 17c28a2aaa4b4d4bada90cea2b8ccff5. Resources: {'instances', 'cores', 'ram'} {{(pid=117884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 22 11:22:18.822733 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.quota [None req-a257a942-af1b-4d7d-a880-1ad4e164d3de tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Getting quotas for user 2e46f6bf93bf4e839a0dfebd5409f32e and project 17c28a2aaa4b4d4bada90cea2b8ccff5. Resources: {'instances', 'cores', 'ram'} {{(pid=117884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 22 11:22:18.838617 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-a257a942-af1b-4d7d-a880-1ad4e164d3de tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Going to run 1 instances... {{(pid=117884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 22 11:22:18.842424 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-a257a942-af1b-4d7d-a880-1ad4e164d3de tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] [instance: 8f8f0931-c690-4076-8001-2a586cac21f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1a6c3cb4-9f56-44c6-aa68-01000df27209',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 22 11:22:18.904431 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-a257a942-af1b-4d7d-a880-1ad4e164d3de tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.584266 Jul 22 11:22:18.905176 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 467/946] 10.222.0.20 () {60 vars in 1146 bytes} [Fri Jul 22 11:22:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 587 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 22 11:22:18.915135 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_api:SELECT=17 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:22:18.916448 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=35 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:22:18.923718 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-3182004e-c155-472e-9960-b7741bf79074 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:22:18.924977 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-3182004e-c155-472e-9960-b7741bf79074 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] [instance: 8f8f0931-c690-4076-8001-2a586cac21f5] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:22:18.983690 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-3182004e-c155-472e-9960-b7741bf79074 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e46f6bf93bf4e839a0dfebd5409f32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c28a2aaa4b4d4bada90cea2b8ccff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:22:18.990861 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-3182004e-c155-472e-9960-b7741bf79074 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] 10.222.0.20 "GET /compute/v2.1/servers/8f8f0931-c690-4076-8001-2a586cac21f5" status: 200 len: 1214 microversion: 2.1 time: 0.078690 Jul 22 11:22:18.991765 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 480/947] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:22:18 2022] GET /compute/v2.1/servers/8f8f0931-c690-4076-8001-2a586cac21f5 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:22:20.009292 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-2d5d1186-eabc-4bf1-85ea-8a778d2207a3 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:22:20.010093 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-2d5d1186-eabc-4bf1-85ea-8a778d2207a3 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] [instance: 8f8f0931-c690-4076-8001-2a586cac21f5] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:22:20.018194 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-2d5d1186-eabc-4bf1-85ea-8a778d2207a3 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:20.018646 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-2d5d1186-eabc-4bf1-85ea-8a778d2207a3 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:20.019493 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-2d5d1186-eabc-4bf1-85ea-8a778d2207a3 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:20.019920 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-2d5d1186-eabc-4bf1-85ea-8a778d2207a3 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:20.100085 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-2d5d1186-eabc-4bf1-85ea-8a778d2207a3 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e46f6bf93bf4e839a0dfebd5409f32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c28a2aaa4b4d4bada90cea2b8ccff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:22:20.107811 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-2d5d1186-eabc-4bf1-85ea-8a778d2207a3 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] 10.222.0.20 "GET /compute/v2.1/servers/8f8f0931-c690-4076-8001-2a586cac21f5" status: 200 len: 1266 microversion: 2.1 time: 0.103255 Jul 22 11:22:20.108392 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 468/948] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:22:20 2022] GET /compute/v2.1/servers/8f8f0931-c690-4076-8001-2a586cac21f5 => generated 1266 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:22:21.133061 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-1dd7b08f-8a66-491d-9c8d-9c199abb5979 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:22:21.133783 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-1dd7b08f-8a66-491d-9c8d-9c199abb5979 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] [instance: 8f8f0931-c690-4076-8001-2a586cac21f5] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:22:21.141151 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1dd7b08f-8a66-491d-9c8d-9c199abb5979 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:21.141601 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1dd7b08f-8a66-491d-9c8d-9c199abb5979 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:21.142446 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1dd7b08f-8a66-491d-9c8d-9c199abb5979 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:21.142968 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1dd7b08f-8a66-491d-9c8d-9c199abb5979 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:21.288164 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-1dd7b08f-8a66-491d-9c8d-9c199abb5979 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e46f6bf93bf4e839a0dfebd5409f32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c28a2aaa4b4d4bada90cea2b8ccff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:22:21.296321 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-1dd7b08f-8a66-491d-9c8d-9c199abb5979 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] 10.222.0.20 "GET /compute/v2.1/servers/8f8f0931-c690-4076-8001-2a586cac21f5" status: 200 len: 1314 microversion: 2.1 time: 0.167119 Jul 22 11:22:21.297180 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 481/949] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:22:21 2022] GET /compute/v2.1/servers/8f8f0931-c690-4076-8001-2a586cac21f5 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:22:21.372490 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-23243b21-52f8-4fb1-bc45-ec4bc4eb3646 tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1563914134", "imageRef": "1a6c3cb4-9f56-44c6-aa68-01000df27209", "flavorRef": "452"}} {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:22:21.427117 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.network.neutron [None req-23243b21-52f8-4fb1-bc45-ec4bc4eb3646 tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] validate_networks() for None {{(pid=117884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 22 11:22:21.821590 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.virt.hardware [None req-23243b21-52f8-4fb1-bc45-ec4bc4eb3646 tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Flavor limits 0:0:0 {{(pid=117884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 22 11:22:21.822799 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.virt.hardware [None req-23243b21-52f8-4fb1-bc45-ec4bc4eb3646 tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Image limits 0:0:0 {{(pid=117884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 22 11:22:21.823471 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.virt.hardware [None req-23243b21-52f8-4fb1-bc45-ec4bc4eb3646 tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Flavor pref 0:0:0 {{(pid=117884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 22 11:22:21.823897 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.virt.hardware [None req-23243b21-52f8-4fb1-bc45-ec4bc4eb3646 tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Image pref 0:0:0 {{(pid=117884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 22 11:22:21.824310 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.virt.hardware [None req-23243b21-52f8-4fb1-bc45-ec4bc4eb3646 tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 22 11:22:21.834647 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-23243b21-52f8-4fb1-bc45-ec4bc4eb3646 tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:21.835090 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-23243b21-52f8-4fb1-bc45-ec4bc4eb3646 tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:21.835916 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-23243b21-52f8-4fb1-bc45-ec4bc4eb3646 tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:21.836459 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-23243b21-52f8-4fb1-bc45-ec4bc4eb3646 tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:21.858049 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.quota [None req-23243b21-52f8-4fb1-bc45-ec4bc4eb3646 tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Getting quotas for project ee8f2050ff1d48c7871edba63439e007. Resources: {'instances', 'cores', 'ram'} {{(pid=117884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 22 11:22:21.862093 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.quota [None req-23243b21-52f8-4fb1-bc45-ec4bc4eb3646 tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Getting quotas for user 5b6bfa46cc3849d2a9b11fd41912722e and project ee8f2050ff1d48c7871edba63439e007. Resources: {'instances', 'cores', 'ram'} {{(pid=117884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 22 11:22:21.873275 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-23243b21-52f8-4fb1-bc45-ec4bc4eb3646 tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Going to run 1 instances... {{(pid=117884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 22 11:22:21.876240 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-23243b21-52f8-4fb1-bc45-ec4bc4eb3646 tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] [instance: 20ac1d4f-6e62-4639-a857-268f248e6663] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1a6c3cb4-9f56-44c6-aa68-01000df27209',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 22 11:22:21.925109 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-23243b21-52f8-4fb1-bc45-ec4bc4eb3646 tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.556427 Jul 22 11:22:21.926124 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 469/950] 10.222.0.20 () {60 vars in 1146 bytes} [Fri Jul 22 11:22:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 558 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 22 11:22:21.936446 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-34dab5d5-7ec0-4ffd-97e0-d4c4dd963f11 tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:22:21.937169 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-34dab5d5-7ec0-4ffd-97e0-d4c4dd963f11 tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] [instance: 20ac1d4f-6e62-4639-a857-268f248e6663] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:22:22.004248 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-34dab5d5-7ec0-4ffd-97e0-d4c4dd963f11 tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6bfa46cc3849d2a9b11fd41912722e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8f2050ff1d48c7871edba63439e007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:22:22.012809 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-34dab5d5-7ec0-4ffd-97e0-d4c4dd963f11 tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] 10.222.0.20 "GET /compute/v2.1/servers/20ac1d4f-6e62-4639-a857-268f248e6663" status: 200 len: 1215 microversion: 2.1 time: 0.080603 Jul 22 11:22:22.014187 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 482/951] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:22:21 2022] GET /compute/v2.1/servers/20ac1d4f-6e62-4639-a857-268f248e6663 => generated 1215 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:22:22.142975 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [req-3d1fb171-084a-4db4-a7b1-e820c81aa71e req-18deff35-b57f-4cde-8aca-28e0cb7a7d5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f8f0931-c690-4076-8001-2a586cac21f5", "tag": "7ec40a91-b87c-47d5-b76a-cdbf8b13d73e"}]} {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:22:22.153342 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-3d1fb171-084a-4db4-a7b1-e820c81aa71e req-18deff35-b57f-4cde-8aca-28e0cb7a7d5b service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:22.154342 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-3d1fb171-084a-4db4-a7b1-e820c81aa71e req-18deff35-b57f-4cde-8aca-28e0cb7a7d5b service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:22.171038 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.compute.server_external_events [req-3d1fb171-084a-4db4-a7b1-e820c81aa71e req-18deff35-b57f-4cde-8aca-28e0cb7a7d5b service nova] Creating event network-changed:7ec40a91-b87c-47d5-b76a-cdbf8b13d73e for instance 8f8f0931-c690-4076-8001-2a586cac21f5 on hv-cinder-84890 Jul 22 11:22:22.178110 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [req-3d1fb171-084a-4db4-a7b1-e820c81aa71e req-18deff35-b57f-4cde-8aca-28e0cb7a7d5b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040282 Jul 22 11:22:22.179316 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 470/952] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:22:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:22:22.322029 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-fd72a2b7-08b0-4609-a28e-c1502510fc36 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:22:22.324256 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-fd72a2b7-08b0-4609-a28e-c1502510fc36 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] [instance: 8f8f0931-c690-4076-8001-2a586cac21f5] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:22:22.352550 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fd72a2b7-08b0-4609-a28e-c1502510fc36 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:22.353661 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fd72a2b7-08b0-4609-a28e-c1502510fc36 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:22.355211 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fd72a2b7-08b0-4609-a28e-c1502510fc36 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:22.356139 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fd72a2b7-08b0-4609-a28e-c1502510fc36 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:22.543433 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-fd72a2b7-08b0-4609-a28e-c1502510fc36 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e46f6bf93bf4e839a0dfebd5409f32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c28a2aaa4b4d4bada90cea2b8ccff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:22:22.554926 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-fd72a2b7-08b0-4609-a28e-c1502510fc36 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] 10.222.0.20 "GET /compute/v2.1/servers/8f8f0931-c690-4076-8001-2a586cac21f5" status: 200 len: 1314 microversion: 2.1 time: 0.243569 Jul 22 11:22:22.555800 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 483/953] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:22:22 2022] GET /compute/v2.1/servers/8f8f0931-c690-4076-8001-2a586cac21f5 => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:22:23.036116 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-c017fa83-3765-43b1-956e-6b4089e7c7c0 tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:22:23.036984 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-c017fa83-3765-43b1-956e-6b4089e7c7c0 tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] [instance: 20ac1d4f-6e62-4639-a857-268f248e6663] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:22:23.043342 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c017fa83-3765-43b1-956e-6b4089e7c7c0 tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:23.043797 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c017fa83-3765-43b1-956e-6b4089e7c7c0 tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:23.044578 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c017fa83-3765-43b1-956e-6b4089e7c7c0 tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:23.045009 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c017fa83-3765-43b1-956e-6b4089e7c7c0 tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:23.111238 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-c017fa83-3765-43b1-956e-6b4089e7c7c0 tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6bfa46cc3849d2a9b11fd41912722e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8f2050ff1d48c7871edba63439e007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:22:23.119208 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-c017fa83-3765-43b1-956e-6b4089e7c7c0 tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] 10.222.0.20 "GET /compute/v2.1/servers/20ac1d4f-6e62-4639-a857-268f248e6663" status: 200 len: 1267 microversion: 2.1 time: 0.092171 Jul 22 11:22:23.119822 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 471/954] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:22:23 2022] GET /compute/v2.1/servers/20ac1d4f-6e62-4639-a857-268f248e6663 => generated 1267 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:22:23.576927 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-b3cfb57d-a479-438f-8a9c-4298aa564733 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:22:23.577540 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-b3cfb57d-a479-438f-8a9c-4298aa564733 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] [instance: 8f8f0931-c690-4076-8001-2a586cac21f5] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:22:23.584605 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b3cfb57d-a479-438f-8a9c-4298aa564733 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:23.585053 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b3cfb57d-a479-438f-8a9c-4298aa564733 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:23.585840 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b3cfb57d-a479-438f-8a9c-4298aa564733 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:23.586278 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b3cfb57d-a479-438f-8a9c-4298aa564733 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:23.735169 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-b3cfb57d-a479-438f-8a9c-4298aa564733 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e46f6bf93bf4e839a0dfebd5409f32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c28a2aaa4b4d4bada90cea2b8ccff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:22:23.746871 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-b3cfb57d-a479-438f-8a9c-4298aa564733 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] 10.222.0.20 "GET /compute/v2.1/servers/8f8f0931-c690-4076-8001-2a586cac21f5" status: 200 len: 1314 microversion: 2.1 time: 0.173800 Jul 22 11:22:23.747518 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 484/955] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:22:23 2022] GET /compute/v2.1/servers/8f8f0931-c690-4076-8001-2a586cac21f5 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:22:24.136788 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-ee302cfc-9dea-4286-a146-5d905c59811a tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:22:24.137401 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-ee302cfc-9dea-4286-a146-5d905c59811a tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] [instance: 20ac1d4f-6e62-4639-a857-268f248e6663] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:22:24.144291 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-ee302cfc-9dea-4286-a146-5d905c59811a tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:24.144731 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-ee302cfc-9dea-4286-a146-5d905c59811a tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:24.145523 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-ee302cfc-9dea-4286-a146-5d905c59811a tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:24.145957 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-ee302cfc-9dea-4286-a146-5d905c59811a tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:24.236076 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-ee302cfc-9dea-4286-a146-5d905c59811a tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6bfa46cc3849d2a9b11fd41912722e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8f2050ff1d48c7871edba63439e007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:22:24.246912 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-ee302cfc-9dea-4286-a146-5d905c59811a tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] 10.222.0.20 "GET /compute/v2.1/servers/20ac1d4f-6e62-4639-a857-268f248e6663" status: 200 len: 1273 microversion: 2.1 time: 0.113860 Jul 22 11:22:24.247591 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 472/956] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:22:24 2022] GET /compute/v2.1/servers/20ac1d4f-6e62-4639-a857-268f248e6663 => generated 1273 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:22:24.766097 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-1ed59974-bf5e-4ca4-a0e6-2ad1bc57571d tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:22:24.766792 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-1ed59974-bf5e-4ca4-a0e6-2ad1bc57571d tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] [instance: 8f8f0931-c690-4076-8001-2a586cac21f5] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:22:24.774642 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1ed59974-bf5e-4ca4-a0e6-2ad1bc57571d tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:24.775137 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1ed59974-bf5e-4ca4-a0e6-2ad1bc57571d tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:24.776017 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1ed59974-bf5e-4ca4-a0e6-2ad1bc57571d tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:24.776490 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1ed59974-bf5e-4ca4-a0e6-2ad1bc57571d tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:24.926001 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-1ed59974-bf5e-4ca4-a0e6-2ad1bc57571d tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e46f6bf93bf4e839a0dfebd5409f32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c28a2aaa4b4d4bada90cea2b8ccff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:22:24.934689 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-1ed59974-bf5e-4ca4-a0e6-2ad1bc57571d tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] 10.222.0.20 "GET /compute/v2.1/servers/8f8f0931-c690-4076-8001-2a586cac21f5" status: 200 len: 1314 microversion: 2.1 time: 0.172736 Jul 22 11:22:24.935295 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 485/957] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:22:24 2022] GET /compute/v2.1/servers/8f8f0931-c690-4076-8001-2a586cac21f5 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:22:25.264299 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-fccf1801-aa21-49d3-a1d3-b0e67f87e05e tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:22:25.264945 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-fccf1801-aa21-49d3-a1d3-b0e67f87e05e tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] [instance: 20ac1d4f-6e62-4639-a857-268f248e6663] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:22:25.272960 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-fccf1801-aa21-49d3-a1d3-b0e67f87e05e tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:25.273424 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-fccf1801-aa21-49d3-a1d3-b0e67f87e05e tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:25.274669 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-fccf1801-aa21-49d3-a1d3-b0e67f87e05e tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:25.275462 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-fccf1801-aa21-49d3-a1d3-b0e67f87e05e tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:25.534163 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-fccf1801-aa21-49d3-a1d3-b0e67f87e05e tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6bfa46cc3849d2a9b11fd41912722e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8f2050ff1d48c7871edba63439e007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:22:25.543130 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-fccf1801-aa21-49d3-a1d3-b0e67f87e05e tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] 10.222.0.20 "GET /compute/v2.1/servers/20ac1d4f-6e62-4639-a857-268f248e6663" status: 200 len: 1315 microversion: 2.1 time: 0.282807 Jul 22 11:22:25.544913 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 473/958] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:22:25 2022] GET /compute/v2.1/servers/20ac1d4f-6e62-4639-a857-268f248e6663 => generated 1315 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:22:25.953525 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-c52947e9-801d-4ed9-8731-23dc9dc37aa5 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:22:25.954166 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-c52947e9-801d-4ed9-8731-23dc9dc37aa5 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] [instance: 8f8f0931-c690-4076-8001-2a586cac21f5] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:22:25.961678 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c52947e9-801d-4ed9-8731-23dc9dc37aa5 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:25.962141 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c52947e9-801d-4ed9-8731-23dc9dc37aa5 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:25.962933 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c52947e9-801d-4ed9-8731-23dc9dc37aa5 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:25.963397 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c52947e9-801d-4ed9-8731-23dc9dc37aa5 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:26.124824 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-c52947e9-801d-4ed9-8731-23dc9dc37aa5 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e46f6bf93bf4e839a0dfebd5409f32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c28a2aaa4b4d4bada90cea2b8ccff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:22:26.135824 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-c52947e9-801d-4ed9-8731-23dc9dc37aa5 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] 10.222.0.20 "GET /compute/v2.1/servers/8f8f0931-c690-4076-8001-2a586cac21f5" status: 200 len: 1314 microversion: 2.1 time: 0.186349 Jul 22 11:22:26.136587 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 486/959] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:22:25 2022] GET /compute/v2.1/servers/8f8f0931-c690-4076-8001-2a586cac21f5 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:22:26.185015 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [req-7088b831-67c8-4959-8e51-d807da6dd3f0 req-b59698e7-b84b-4c2f-a004-24ae877402a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20ac1d4f-6e62-4639-a857-268f248e6663", "tag": "332966ad-58ca-47a0-91ea-36872b984bf3"}]} {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:22:26.213298 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-7088b831-67c8-4959-8e51-d807da6dd3f0 req-b59698e7-b84b-4c2f-a004-24ae877402a8 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:26.214205 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-7088b831-67c8-4959-8e51-d807da6dd3f0 req-b59698e7-b84b-4c2f-a004-24ae877402a8 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:26.231578 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.compute.server_external_events [req-7088b831-67c8-4959-8e51-d807da6dd3f0 req-b59698e7-b84b-4c2f-a004-24ae877402a8 service nova] Creating event network-changed:332966ad-58ca-47a0-91ea-36872b984bf3 for instance 20ac1d4f-6e62-4639-a857-268f248e6663 on hv-cinder-84890 Jul 22 11:22:26.237264 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [req-7088b831-67c8-4959-8e51-d807da6dd3f0 req-b59698e7-b84b-4c2f-a004-24ae877402a8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060422 Jul 22 11:22:26.238193 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 474/960] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:22:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:22:26.564938 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-55260495-6187-4c08-8942-0a361cf5fe2a tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:22:26.566023 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-55260495-6187-4c08-8942-0a361cf5fe2a tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] [instance: 20ac1d4f-6e62-4639-a857-268f248e6663] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:22:26.572375 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-55260495-6187-4c08-8942-0a361cf5fe2a tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:26.572949 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-55260495-6187-4c08-8942-0a361cf5fe2a tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:26.573627 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-55260495-6187-4c08-8942-0a361cf5fe2a tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:26.574265 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-55260495-6187-4c08-8942-0a361cf5fe2a tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:26.766882 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-55260495-6187-4c08-8942-0a361cf5fe2a tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6bfa46cc3849d2a9b11fd41912722e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8f2050ff1d48c7871edba63439e007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:22:26.776129 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-55260495-6187-4c08-8942-0a361cf5fe2a tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] 10.222.0.20 "GET /compute/v2.1/servers/20ac1d4f-6e62-4639-a857-268f248e6663" status: 200 len: 1315 microversion: 2.1 time: 0.217127 Jul 22 11:22:26.776721 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 487/961] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:22:26 2022] GET /compute/v2.1/servers/20ac1d4f-6e62-4639-a857-268f248e6663 => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:22:27.157763 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-af36c9cc-84a5-43ec-a2fa-5438939ab15c tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:22:27.159043 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-af36c9cc-84a5-43ec-a2fa-5438939ab15c tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] [instance: 8f8f0931-c690-4076-8001-2a586cac21f5] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:22:27.169104 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-af36c9cc-84a5-43ec-a2fa-5438939ab15c tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:27.169561 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-af36c9cc-84a5-43ec-a2fa-5438939ab15c tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:27.170367 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-af36c9cc-84a5-43ec-a2fa-5438939ab15c tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:27.170960 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-af36c9cc-84a5-43ec-a2fa-5438939ab15c tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:27.339148 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-af36c9cc-84a5-43ec-a2fa-5438939ab15c tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e46f6bf93bf4e839a0dfebd5409f32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c28a2aaa4b4d4bada90cea2b8ccff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:22:27.354139 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-af36c9cc-84a5-43ec-a2fa-5438939ab15c tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] 10.222.0.20 "GET /compute/v2.1/servers/8f8f0931-c690-4076-8001-2a586cac21f5" status: 200 len: 1314 microversion: 2.1 time: 0.203613 Jul 22 11:22:27.354808 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 475/962] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:22:27 2022] GET /compute/v2.1/servers/8f8f0931-c690-4076-8001-2a586cac21f5 => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:22:27.796122 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-6ee23014-b216-437a-9ef7-16c1ae1dabd3 tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:22:27.797667 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-6ee23014-b216-437a-9ef7-16c1ae1dabd3 tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] [instance: 20ac1d4f-6e62-4639-a857-268f248e6663] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:22:27.804501 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6ee23014-b216-437a-9ef7-16c1ae1dabd3 tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:27.804949 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6ee23014-b216-437a-9ef7-16c1ae1dabd3 tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:27.805783 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6ee23014-b216-437a-9ef7-16c1ae1dabd3 tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:27.806222 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6ee23014-b216-437a-9ef7-16c1ae1dabd3 tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:27.949920 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-6ee23014-b216-437a-9ef7-16c1ae1dabd3 tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6bfa46cc3849d2a9b11fd41912722e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8f2050ff1d48c7871edba63439e007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:22:27.958073 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-6ee23014-b216-437a-9ef7-16c1ae1dabd3 tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] 10.222.0.20 "GET /compute/v2.1/servers/20ac1d4f-6e62-4639-a857-268f248e6663" status: 200 len: 1315 microversion: 2.1 time: 0.166511 Jul 22 11:22:27.958795 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 488/963] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:22:27 2022] GET /compute/v2.1/servers/20ac1d4f-6e62-4639-a857-268f248e6663 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:22:28.373815 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-793fb951-6e48-45e9-9a48-6505b2b50552 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:22:28.374896 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-793fb951-6e48-45e9-9a48-6505b2b50552 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] [instance: 8f8f0931-c690-4076-8001-2a586cac21f5] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:22:28.384128 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-793fb951-6e48-45e9-9a48-6505b2b50552 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:28.384712 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-793fb951-6e48-45e9-9a48-6505b2b50552 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:28.385891 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-793fb951-6e48-45e9-9a48-6505b2b50552 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:28.386693 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-793fb951-6e48-45e9-9a48-6505b2b50552 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:28.491465 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-7ac2d350-d6f3-422a-a110-92383d4d10dd req-7d6f807e-490d-4b1c-9045-daa10287c01f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f8f0931-c690-4076-8001-2a586cac21f5", "name": "network-vif-plugged", "status": "completed", "tag": "7ec40a91-b87c-47d5-b76a-cdbf8b13d73e"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:22:28.502715 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-7ac2d350-d6f3-422a-a110-92383d4d10dd req-7d6f807e-490d-4b1c-9045-daa10287c01f service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:28.503252 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-7ac2d350-d6f3-422a-a110-92383d4d10dd req-7d6f807e-490d-4b1c-9045-daa10287c01f service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:28.520758 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-7ac2d350-d6f3-422a-a110-92383d4d10dd req-7d6f807e-490d-4b1c-9045-daa10287c01f service nova] Creating event network-vif-plugged:7ec40a91-b87c-47d5-b76a-cdbf8b13d73e for instance 8f8f0931-c690-4076-8001-2a586cac21f5 on hv-cinder-84890 Jul 22 11:22:28.536171 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-7ac2d350-d6f3-422a-a110-92383d4d10dd req-7d6f807e-490d-4b1c-9045-daa10287c01f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049092 Jul 22 11:22:28.537011 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 489/964] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:22:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:22:28.556196 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-793fb951-6e48-45e9-9a48-6505b2b50552 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e46f6bf93bf4e839a0dfebd5409f32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c28a2aaa4b4d4bada90cea2b8ccff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:22:28.571556 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-793fb951-6e48-45e9-9a48-6505b2b50552 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] 10.222.0.20 "GET /compute/v2.1/servers/8f8f0931-c690-4076-8001-2a586cac21f5" status: 200 len: 1314 microversion: 2.1 time: 0.201797 Jul 22 11:22:28.572145 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 476/965] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:22:28 2022] GET /compute/v2.1/servers/8f8f0931-c690-4076-8001-2a586cac21f5 => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:22:28.976954 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-3b6b4461-2968-44b4-9950-175da21f5cc9 tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:22:28.977528 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-3b6b4461-2968-44b4-9950-175da21f5cc9 tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] [instance: 20ac1d4f-6e62-4639-a857-268f248e6663] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:22:28.984430 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3b6b4461-2968-44b4-9950-175da21f5cc9 tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:28.985074 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3b6b4461-2968-44b4-9950-175da21f5cc9 tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:28.986463 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3b6b4461-2968-44b4-9950-175da21f5cc9 tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:28.987202 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3b6b4461-2968-44b4-9950-175da21f5cc9 tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:29.367390 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-3b6b4461-2968-44b4-9950-175da21f5cc9 tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6bfa46cc3849d2a9b11fd41912722e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8f2050ff1d48c7871edba63439e007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:22:29.375620 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-3b6b4461-2968-44b4-9950-175da21f5cc9 tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] 10.222.0.20 "GET /compute/v2.1/servers/20ac1d4f-6e62-4639-a857-268f248e6663" status: 200 len: 1315 microversion: 2.1 time: 0.403428 Jul 22 11:22:29.376237 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 490/966] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:22:28 2022] GET /compute/v2.1/servers/20ac1d4f-6e62-4639-a857-268f248e6663 => generated 1315 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:22:29.589523 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-2717691b-f0b8-43fc-99b5-4893894e752a tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:22:29.590155 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-2717691b-f0b8-43fc-99b5-4893894e752a tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] [instance: 8f8f0931-c690-4076-8001-2a586cac21f5] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:22:29.600309 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-2717691b-f0b8-43fc-99b5-4893894e752a tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:29.600767 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-2717691b-f0b8-43fc-99b5-4893894e752a tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:29.602095 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-2717691b-f0b8-43fc-99b5-4893894e752a tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:29.602560 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-2717691b-f0b8-43fc-99b5-4893894e752a tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:29.772157 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-2717691b-f0b8-43fc-99b5-4893894e752a tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e46f6bf93bf4e839a0dfebd5409f32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c28a2aaa4b4d4bada90cea2b8ccff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:22:29.780148 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-2717691b-f0b8-43fc-99b5-4893894e752a tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] 10.222.0.20 "GET /compute/v2.1/servers/8f8f0931-c690-4076-8001-2a586cac21f5" status: 200 len: 1314 microversion: 2.1 time: 0.194478 Jul 22 11:22:29.780884 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 477/967] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:22:29 2022] GET /compute/v2.1/servers/8f8f0931-c690-4076-8001-2a586cac21f5 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:22:30.398726 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-05ec685b-4fc3-400d-be1c-aefdf534a6d0 tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:22:30.399562 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-05ec685b-4fc3-400d-be1c-aefdf534a6d0 tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] [instance: 20ac1d4f-6e62-4639-a857-268f248e6663] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:22:30.407430 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-05ec685b-4fc3-400d-be1c-aefdf534a6d0 tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:30.407890 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-05ec685b-4fc3-400d-be1c-aefdf534a6d0 tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:30.408895 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-05ec685b-4fc3-400d-be1c-aefdf534a6d0 tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:30.409534 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-05ec685b-4fc3-400d-be1c-aefdf534a6d0 tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:30.566774 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-05ec685b-4fc3-400d-be1c-aefdf534a6d0 tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6bfa46cc3849d2a9b11fd41912722e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8f2050ff1d48c7871edba63439e007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:22:30.575019 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-05ec685b-4fc3-400d-be1c-aefdf534a6d0 tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] 10.222.0.20 "GET /compute/v2.1/servers/20ac1d4f-6e62-4639-a857-268f248e6663" status: 200 len: 1315 microversion: 2.1 time: 0.181003 Jul 22 11:22:30.575658 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 491/968] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:22:30 2022] GET /compute/v2.1/servers/20ac1d4f-6e62-4639-a857-268f248e6663 => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:22:30.797182 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-a26a93ca-b15d-4760-8df2-c46aab3b3e7b tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:22:30.797771 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-a26a93ca-b15d-4760-8df2-c46aab3b3e7b tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] [instance: 8f8f0931-c690-4076-8001-2a586cac21f5] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:22:30.804862 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-a26a93ca-b15d-4760-8df2-c46aab3b3e7b tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:30.805310 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-a26a93ca-b15d-4760-8df2-c46aab3b3e7b tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:30.806132 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-a26a93ca-b15d-4760-8df2-c46aab3b3e7b tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:30.806597 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-a26a93ca-b15d-4760-8df2-c46aab3b3e7b tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:30.959820 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-a26a93ca-b15d-4760-8df2-c46aab3b3e7b tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e46f6bf93bf4e839a0dfebd5409f32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c28a2aaa4b4d4bada90cea2b8ccff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:22:30.974452 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-a26a93ca-b15d-4760-8df2-c46aab3b3e7b tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] 10.222.0.20 "GET /compute/v2.1/servers/8f8f0931-c690-4076-8001-2a586cac21f5" status: 200 len: 1498 microversion: 2.1 time: 0.181136 Jul 22 11:22:30.975053 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 478/969] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:22:30 2022] GET /compute/v2.1/servers/8f8f0931-c690-4076-8001-2a586cac21f5 => generated 1498 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:22:31.439530 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-93608b14-e597-435d-af31-f51a03188a52 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:22:31.440249 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-93608b14-e597-435d-af31-f51a03188a52 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] [instance: 8f8f0931-c690-4076-8001-2a586cac21f5] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:22:31.447041 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-93608b14-e597-435d-af31-f51a03188a52 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:31.447589 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-93608b14-e597-435d-af31-f51a03188a52 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:31.448570 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-93608b14-e597-435d-af31-f51a03188a52 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:31.449158 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-93608b14-e597-435d-af31-f51a03188a52 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:31.480757 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-93608b14-e597-435d-af31-f51a03188a52 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] [instance: 8f8f0931-c690-4076-8001-2a586cac21f5] Going to try to terminate instance {{(pid=117885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 22 11:22:31.575662 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-93608b14-e597-435d-af31-f51a03188a52 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8f8f0931-c690-4076-8001-2a586cac21f5" status: 204 len: 0 microversion: 2.1 time: 0.139959 Jul 22 11:22:31.576816 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 492/970] 10.222.0.20 () {58 vars in 1238 bytes} [Fri Jul 22 11:22:31 2022] DELETE /compute/v2.1/servers/8f8f0931-c690-4076-8001-2a586cac21f5 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 22 11:22:31.588860 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-3ffe6fdc-672f-488c-851c-8880e2db6b5b tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:22:31.589566 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-3ffe6fdc-672f-488c-851c-8880e2db6b5b tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] [instance: 8f8f0931-c690-4076-8001-2a586cac21f5] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:22:31.596103 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-30c2eabb-0257-4003-8ce9-4ad28774e855 tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:22:31.596615 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-3ffe6fdc-672f-488c-851c-8880e2db6b5b tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:31.596771 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-30c2eabb-0257-4003-8ce9-4ad28774e855 tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] [instance: 20ac1d4f-6e62-4639-a857-268f248e6663] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:22:31.597668 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-3ffe6fdc-672f-488c-851c-8880e2db6b5b tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:31.598797 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-3ffe6fdc-672f-488c-851c-8880e2db6b5b tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:31.599440 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-3ffe6fdc-672f-488c-851c-8880e2db6b5b tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:31.605231 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-30c2eabb-0257-4003-8ce9-4ad28774e855 tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:31.605762 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-30c2eabb-0257-4003-8ce9-4ad28774e855 tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:31.606620 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-30c2eabb-0257-4003-8ce9-4ad28774e855 tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:31.607074 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-30c2eabb-0257-4003-8ce9-4ad28774e855 tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:31.756570 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-3ffe6fdc-672f-488c-851c-8880e2db6b5b tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e46f6bf93bf4e839a0dfebd5409f32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c28a2aaa4b4d4bada90cea2b8ccff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:22:31.766996 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-30c2eabb-0257-4003-8ce9-4ad28774e855 tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6bfa46cc3849d2a9b11fd41912722e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8f2050ff1d48c7871edba63439e007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:22:31.769053 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-3ffe6fdc-672f-488c-851c-8880e2db6b5b tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] 10.222.0.20 "GET /compute/v2.1/servers/8f8f0931-c690-4076-8001-2a586cac21f5" status: 200 len: 1504 microversion: 2.1 time: 0.185596 Jul 22 11:22:31.770009 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 479/971] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:22:31 2022] GET /compute/v2.1/servers/8f8f0931-c690-4076-8001-2a586cac21f5 => generated 1504 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:22:31.778929 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-30c2eabb-0257-4003-8ce9-4ad28774e855 tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] 10.222.0.20 "GET /compute/v2.1/servers/20ac1d4f-6e62-4639-a857-268f248e6663" status: 200 len: 1315 microversion: 2.1 time: 0.189683 Jul 22 11:22:31.779760 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 493/972] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:22:31 2022] GET /compute/v2.1/servers/20ac1d4f-6e62-4639-a857-268f248e6663 => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:22:32.530020 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [req-e883c986-587f-4124-8bb9-1618e8504be0 req-19dd94b2-c549-4c26-8668-558b598b0e48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20ac1d4f-6e62-4639-a857-268f248e6663", "name": "network-vif-plugged", "status": "completed", "tag": "332966ad-58ca-47a0-91ea-36872b984bf3"}]} {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:22:32.537238 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG dbcounter [-] [117884] Writing DB stats nova_cell0:SELECT=4 {{(pid=117884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:22:32.538474 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG dbcounter [-] [117884] Writing DB stats nova_cell0:SELECT=12 {{(pid=117884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:22:32.547215 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-e883c986-587f-4124-8bb9-1618e8504be0 req-19dd94b2-c549-4c26-8668-558b598b0e48 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:32.547794 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-e883c986-587f-4124-8bb9-1618e8504be0 req-19dd94b2-c549-4c26-8668-558b598b0e48 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:32.562569 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.compute.server_external_events [req-e883c986-587f-4124-8bb9-1618e8504be0 req-19dd94b2-c549-4c26-8668-558b598b0e48 service nova] Creating event network-vif-plugged:332966ad-58ca-47a0-91ea-36872b984bf3 for instance 20ac1d4f-6e62-4639-a857-268f248e6663 on hv-cinder-84890 Jul 22 11:22:32.568804 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [req-e883c986-587f-4124-8bb9-1618e8504be0 req-19dd94b2-c549-4c26-8668-558b598b0e48 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043728 Jul 22 11:22:32.569716 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 480/973] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:22:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 22 11:22:32.788731 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-6ed7e61d-2d39-46d8-8d16-f352f52184ee tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:22:32.789572 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-6ed7e61d-2d39-46d8-8d16-f352f52184ee tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] [instance: 8f8f0931-c690-4076-8001-2a586cac21f5] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:22:32.791815 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell0:SELECT=4 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:22:32.798716 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6ed7e61d-2d39-46d8-8d16-f352f52184ee tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:32.799166 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6ed7e61d-2d39-46d8-8d16-f352f52184ee tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:32.800012 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6ed7e61d-2d39-46d8-8d16-f352f52184ee tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:32.800587 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-4deadb45-219f-48cd-a622-f8a7bebb65cf tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:22:32.801411 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6ed7e61d-2d39-46d8-8d16-f352f52184ee tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:32.801651 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-4deadb45-219f-48cd-a622-f8a7bebb65cf tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] [instance: 20ac1d4f-6e62-4639-a857-268f248e6663] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:22:32.808913 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-4deadb45-219f-48cd-a622-f8a7bebb65cf tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:32.809357 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-4deadb45-219f-48cd-a622-f8a7bebb65cf tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:32.810139 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-4deadb45-219f-48cd-a622-f8a7bebb65cf tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:32.810563 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-4deadb45-219f-48cd-a622-f8a7bebb65cf tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:33.002255 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-6ed7e61d-2d39-46d8-8d16-f352f52184ee tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e46f6bf93bf4e839a0dfebd5409f32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c28a2aaa4b4d4bada90cea2b8ccff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:22:33.004125 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-4deadb45-219f-48cd-a622-f8a7bebb65cf tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6bfa46cc3849d2a9b11fd41912722e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8f2050ff1d48c7871edba63439e007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:22:33.012696 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-6ed7e61d-2d39-46d8-8d16-f352f52184ee tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] 10.222.0.20 "GET /compute/v2.1/servers/8f8f0931-c690-4076-8001-2a586cac21f5" status: 200 len: 1504 microversion: 2.1 time: 0.227695 Jul 22 11:22:33.013468 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 494/974] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:22:32 2022] GET /compute/v2.1/servers/8f8f0931-c690-4076-8001-2a586cac21f5 => generated 1504 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:22:33.021642 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-4deadb45-219f-48cd-a622-f8a7bebb65cf tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] 10.222.0.20 "GET /compute/v2.1/servers/20ac1d4f-6e62-4639-a857-268f248e6663" status: 200 len: 1315 microversion: 2.1 time: 0.226917 Jul 22 11:22:33.022240 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 481/975] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:22:32 2022] GET /compute/v2.1/servers/20ac1d4f-6e62-4639-a857-268f248e6663 => generated 1315 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:22:33.921724 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-f513c65b-6713-4241-9352-aa8694b29d36 req-2f92d124-54a3-4008-a664-3db5bba921b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f8f0931-c690-4076-8001-2a586cac21f5", "name": "network-vif-deleted", "tag": "7ec40a91-b87c-47d5-b76a-cdbf8b13d73e"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:22:33.932452 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-f513c65b-6713-4241-9352-aa8694b29d36 req-2f92d124-54a3-4008-a664-3db5bba921b8 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:33.932963 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-f513c65b-6713-4241-9352-aa8694b29d36 req-2f92d124-54a3-4008-a664-3db5bba921b8 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:33.946093 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-f513c65b-6713-4241-9352-aa8694b29d36 req-2f92d124-54a3-4008-a664-3db5bba921b8 service nova] Creating event network-vif-deleted:7ec40a91-b87c-47d5-b76a-cdbf8b13d73e for instance 8f8f0931-c690-4076-8001-2a586cac21f5 on hv-cinder-84890 Jul 22 11:22:33.953329 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-f513c65b-6713-4241-9352-aa8694b29d36 req-2f92d124-54a3-4008-a664-3db5bba921b8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034970 Jul 22 11:22:33.953954 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 495/976] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:22:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:22:34.034594 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-738be90a-72dc-485c-bd96-7f4883601e96 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:22:34.035798 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-738be90a-72dc-485c-bd96-7f4883601e96 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] [instance: 8f8f0931-c690-4076-8001-2a586cac21f5] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:22:34.041262 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-99b90187-8d1e-4eb3-99b9-1db3ad6d3feb tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:22:34.042776 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-99b90187-8d1e-4eb3-99b9-1db3ad6d3feb tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] [instance: 20ac1d4f-6e62-4639-a857-268f248e6663] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:22:34.044839 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-738be90a-72dc-485c-bd96-7f4883601e96 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:34.045809 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-738be90a-72dc-485c-bd96-7f4883601e96 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:34.047474 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-738be90a-72dc-485c-bd96-7f4883601e96 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:34.048233 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-738be90a-72dc-485c-bd96-7f4883601e96 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:34.053865 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-99b90187-8d1e-4eb3-99b9-1db3ad6d3feb tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:34.054492 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-99b90187-8d1e-4eb3-99b9-1db3ad6d3feb tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:34.056032 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-99b90187-8d1e-4eb3-99b9-1db3ad6d3feb tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:34.056718 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-99b90187-8d1e-4eb3-99b9-1db3ad6d3feb tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:34.095652 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-738be90a-72dc-485c-bd96-7f4883601e96 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:34.096347 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-738be90a-72dc-485c-bd96-7f4883601e96 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:34.097124 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.objects.instance [None req-738be90a-72dc-485c-bd96-7f4883601e96 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lazy-loading 'fault' on Instance uuid 8f8f0931-c690-4076-8001-2a586cac21f5 {{(pid=117884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 22 11:22:34.157624 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-738be90a-72dc-485c-bd96-7f4883601e96 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e46f6bf93bf4e839a0dfebd5409f32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c28a2aaa4b4d4bada90cea2b8ccff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:22:34.166080 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-738be90a-72dc-485c-bd96-7f4883601e96 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] 10.222.0.20 "GET /compute/v2.1/servers/8f8f0931-c690-4076-8001-2a586cac21f5" status: 200 len: 1304 microversion: 2.1 time: 0.138535 Jul 22 11:22:34.166672 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 482/977] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:22:34 2022] GET /compute/v2.1/servers/8f8f0931-c690-4076-8001-2a586cac21f5 => generated 1304 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:22:34.234828 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-99b90187-8d1e-4eb3-99b9-1db3ad6d3feb tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6bfa46cc3849d2a9b11fd41912722e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8f2050ff1d48c7871edba63439e007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:22:34.243230 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-99b90187-8d1e-4eb3-99b9-1db3ad6d3feb tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] 10.222.0.20 "GET /compute/v2.1/servers/20ac1d4f-6e62-4639-a857-268f248e6663" status: 200 len: 1315 microversion: 2.1 time: 0.206592 Jul 22 11:22:34.243845 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 496/978] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:22:34 2022] GET /compute/v2.1/servers/20ac1d4f-6e62-4639-a857-268f248e6663 => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:22:35.184549 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-3ebb77e0-3cc6-4a2a-baae-2a5d2a595065 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:22:35.185167 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-3ebb77e0-3cc6-4a2a-baae-2a5d2a595065 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] [instance: 8f8f0931-c690-4076-8001-2a586cac21f5] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:22:35.192573 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-3ebb77e0-3cc6-4a2a-baae-2a5d2a595065 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:35.193019 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-3ebb77e0-3cc6-4a2a-baae-2a5d2a595065 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:35.193792 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-3ebb77e0-3cc6-4a2a-baae-2a5d2a595065 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:35.194222 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-3ebb77e0-3cc6-4a2a-baae-2a5d2a595065 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:35.209281 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.wsgi [None req-3ebb77e0-3cc6-4a2a-baae-2a5d2a595065 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] HTTP exception thrown: Instance 8f8f0931-c690-4076-8001-2a586cac21f5 could not be found. Jul 22 11:22:35.210947 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-3ebb77e0-3cc6-4a2a-baae-2a5d2a595065 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Request method failure captured: Jul 22 11:22:35.210947 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: request: GET /compute/v2.1/servers/8f8f0931-c690-4076-8001-2a586cac21f5 HTTP/1.1 Jul 22 11:22:35.210947 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Accept: application/json Jul 22 11:22:35.210947 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Accept-Encoding: identity Jul 22 11:22:35.210947 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Connection: close Jul 22 11:22:35.210947 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Content-Length: 0 Jul 22 11:22:35.210947 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Content-Type: application/json Jul 22 11:22:35.210947 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Host: 10.222.0.20 Jul 22 11:22:35.210947 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Openstack-System-Scope: None Jul 22 11:22:35.210947 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: User-Agent: python-urllib3/1.26.9 Jul 22 11:22:35.210947 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Auth-Token: gAAAAABi2ohoGuf9hQh7QDnRrPr-PWk3YJOQO8XX-0IQnm_IHKKIQzEkXhJR8SeJA9wVzSvTVARW8j4UNLdjit5ULI4ssTkUbzJo2qCXKtHcybVVRTQlISc_SUlhqmAQ7Fy0fWNmWAvteFVGcqxk1Ke8DMRp2beyHPjaW01AWFx4Rt3IhBE870s Jul 22 11:22:35.210947 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Domain-Id: None Jul 22 11:22:35.210947 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Domain-Name: None Jul 22 11:22:35.210947 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Identity-Status: Confirmed Jul 22 11:22:35.210947 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Is-Admin-Project: True Jul 22 11:22:35.210947 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Domain-Id: default Jul 22 11:22:35.210947 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Domain-Name: Default Jul 22 11:22:35.210947 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Id: 17c28a2aaa4b4d4bada90cea2b8ccff5 Jul 22 11:22:35.210947 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Name: tempest-VolumesActionsTest-573291871 Jul 22 11:22:35.210947 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Role: reader,member Jul 22 11:22:35.210947 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Roles: reader,member Jul 22 11:22:35.212698 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/17c28a2aaa4b4d4bada90cea2b8ccff5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_17c28a2aaa4b4d4bada90cea2b8ccff5", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/17c28a2aaa4b4d4bada90cea2b8ccff5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/17c28a2aaa4b4d4bada90cea2b8ccff5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jul 22 11:22:35.212698 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant: tempest-VolumesActionsTest-573291871 Jul 22 11:22:35.212698 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant-Id: 17c28a2aaa4b4d4bada90cea2b8ccff5 Jul 22 11:22:35.212698 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant-Name: tempest-VolumesActionsTest-573291871 Jul 22 11:22:35.212698 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User: tempest-VolumesActionsTest-573291871-project Jul 22 11:22:35.212698 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Domain-Id: default Jul 22 11:22:35.212698 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Domain-Name: Default Jul 22 11:22:35.212698 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Id: 2e46f6bf93bf4e839a0dfebd5409f32e Jul 22 11:22:35.212698 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Name: tempest-VolumesActionsTest-573291871-project Jul 22 11:22:35.212698 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: method: > Jul 22 11:22:35.212698 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: exception: Instance 8f8f0931-c690-4076-8001-2a586cac21f5 could not be found. Jul 22 11:22:35.212698 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: action_args: {'id': '8f8f0931-c690-4076-8001-2a586cac21f5'} Jul 22 11:22:35.213675 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 22 11:22:35.213675 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:22:35.213675 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 22 11:22:35.213675 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 22 11:22:35.213675 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 22 11:22:35.213675 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 22 11:22:35.213675 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 22 11:22:35.213675 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 22 11:22:35.213675 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 22 11:22:35.213675 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 22 11:22:35.213675 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f8f0931-c690-4076-8001-2a586cac21f5 could not be found. Jul 22 11:22:35.213675 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:22:35.213675 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:22:35.213675 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:22:35.213675 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:22:35.213675 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:22:35.213675 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:22:35.213675 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 22 11:22:35.213675 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 22 11:22:35.213675 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 22 11:22:35.215293 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 22 11:22:35.215293 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 22 11:22:35.215293 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 22 11:22:35.215293 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 22 11:22:35.215293 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 22 11:22:35.215293 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 22 11:22:35.215293 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 22 11:22:35.215293 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f8f0931-c690-4076-8001-2a586cac21f5 could not be found. Jul 22 11:22:35.215293 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:22:35.215293 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:22:35.215293 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:22:35.215293 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:22:35.215293 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:22:35.215293 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:22:35.215293 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 22 11:22:35.215293 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 22 11:22:35.215293 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f8f0931-c690-4076-8001-2a586cac21f5 could not be found. Jul 22 11:22:35.215293 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:22:35.216675 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-3ebb77e0-3cc6-4a2a-baae-2a5d2a595065 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Returning 404 to user: Instance 8f8f0931-c690-4076-8001-2a586cac21f5 could not be found. {{(pid=117884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 22 11:22:35.216675 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-3ebb77e0-3cc6-4a2a-baae-2a5d2a595065 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] 10.222.0.20 "GET /compute/v2.1/servers/8f8f0931-c690-4076-8001-2a586cac21f5" status: 404 len: 111 microversion: 2.1 time: 0.031938 Jul 22 11:22:35.216675 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 483/979] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:22:35 2022] GET /compute/v2.1/servers/8f8f0931-c690-4076-8001-2a586cac21f5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 22 11:22:35.266868 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-c626dc45-4c8e-4a23-b02b-2539799d0e17 tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:22:35.267522 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-c626dc45-4c8e-4a23-b02b-2539799d0e17 tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] [instance: 20ac1d4f-6e62-4639-a857-268f248e6663] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:22:35.276002 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c626dc45-4c8e-4a23-b02b-2539799d0e17 tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:35.276465 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c626dc45-4c8e-4a23-b02b-2539799d0e17 tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:35.277237 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c626dc45-4c8e-4a23-b02b-2539799d0e17 tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:35.277663 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c626dc45-4c8e-4a23-b02b-2539799d0e17 tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:35.327366 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-1cb89af6-31ed-4340-b935-8f577af0f9d0 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1692868899", "imageRef": "1a6c3cb4-9f56-44c6-aa68-01000df27209", "flavorRef": "452", "networks": [{"uuid": "0bb40272-eb7c-4bea-bfbf-46a5f3fdcf2c"}]}} {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:22:35.393423 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.network.neutron [None req-1cb89af6-31ed-4340-b935-8f577af0f9d0 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] validate_networks() for [('0bb40272-eb7c-4bea-bfbf-46a5f3fdcf2c', None, None, None, None, None)] {{(pid=117884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 22 11:22:35.429752 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-c626dc45-4c8e-4a23-b02b-2539799d0e17 tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6bfa46cc3849d2a9b11fd41912722e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8f2050ff1d48c7871edba63439e007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:22:35.439250 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-c626dc45-4c8e-4a23-b02b-2539799d0e17 tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] 10.222.0.20 "GET /compute/v2.1/servers/20ac1d4f-6e62-4639-a857-268f248e6663" status: 200 len: 1465 microversion: 2.1 time: 0.177365 Jul 22 11:22:35.440167 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 497/980] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:22:35 2022] GET /compute/v2.1/servers/20ac1d4f-6e62-4639-a857-268f248e6663 => generated 1465 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:22:35.488833 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-1273fcb5-8174-4e63-a3f3-4cf31318ebd1 tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:22:35.489630 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-1273fcb5-8174-4e63-a3f3-4cf31318ebd1 tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] [instance: 20ac1d4f-6e62-4639-a857-268f248e6663] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:22:35.498524 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1273fcb5-8174-4e63-a3f3-4cf31318ebd1 tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:35.498973 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1273fcb5-8174-4e63-a3f3-4cf31318ebd1 tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:35.499809 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1273fcb5-8174-4e63-a3f3-4cf31318ebd1 tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:35.500243 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1273fcb5-8174-4e63-a3f3-4cf31318ebd1 tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:35.505023 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:22:35.536454 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-1273fcb5-8174-4e63-a3f3-4cf31318ebd1 tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] [instance: 20ac1d4f-6e62-4639-a857-268f248e6663] Going to try to terminate instance {{(pid=117885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 22 11:22:35.641979 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-1273fcb5-8174-4e63-a3f3-4cf31318ebd1 tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] 10.222.0.20 "DELETE /compute/v2.1/servers/20ac1d4f-6e62-4639-a857-268f248e6663" status: 204 len: 0 microversion: 2.1 time: 0.156366 Jul 22 11:22:35.642746 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 498/981] 10.222.0.20 () {58 vars in 1238 bytes} [Fri Jul 22 11:22:35 2022] DELETE /compute/v2.1/servers/20ac1d4f-6e62-4639-a857-268f248e6663 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 22 11:22:35.652677 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-fcc2b5c4-d18c-4654-92b6-4f7d2cda8b08 tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:22:35.653490 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-fcc2b5c4-d18c-4654-92b6-4f7d2cda8b08 tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] [instance: 20ac1d4f-6e62-4639-a857-268f248e6663] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:22:35.661502 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fcc2b5c4-d18c-4654-92b6-4f7d2cda8b08 tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:35.662200 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fcc2b5c4-d18c-4654-92b6-4f7d2cda8b08 tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:35.662785 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fcc2b5c4-d18c-4654-92b6-4f7d2cda8b08 tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:35.663228 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fcc2b5c4-d18c-4654-92b6-4f7d2cda8b08 tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:35.842643 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.virt.hardware [None req-1cb89af6-31ed-4340-b935-8f577af0f9d0 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Flavor limits 0:0:0 {{(pid=117884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 22 11:22:35.842643 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.virt.hardware [None req-1cb89af6-31ed-4340-b935-8f577af0f9d0 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Image limits 0:0:0 {{(pid=117884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 22 11:22:35.844345 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.virt.hardware [None req-1cb89af6-31ed-4340-b935-8f577af0f9d0 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Flavor pref 0:0:0 {{(pid=117884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 22 11:22:35.844588 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.virt.hardware [None req-1cb89af6-31ed-4340-b935-8f577af0f9d0 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Image pref 0:0:0 {{(pid=117884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 22 11:22:35.844995 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.virt.hardware [None req-1cb89af6-31ed-4340-b935-8f577af0f9d0 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 22 11:22:35.848259 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-fcc2b5c4-d18c-4654-92b6-4f7d2cda8b08 tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6bfa46cc3849d2a9b11fd41912722e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8f2050ff1d48c7871edba63439e007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:22:35.856571 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-fcc2b5c4-d18c-4654-92b6-4f7d2cda8b08 tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] 10.222.0.20 "GET /compute/v2.1/servers/20ac1d4f-6e62-4639-a857-268f248e6663" status: 200 len: 1471 microversion: 2.1 time: 0.208142 Jul 22 11:22:35.857156 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 499/982] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:22:35 2022] GET /compute/v2.1/servers/20ac1d4f-6e62-4639-a857-268f248e6663 => generated 1471 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:22:35.865450 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-1cb89af6-31ed-4340-b935-8f577af0f9d0 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:35.865450 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-1cb89af6-31ed-4340-b935-8f577af0f9d0 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:35.865450 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-1cb89af6-31ed-4340-b935-8f577af0f9d0 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:35.865450 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-1cb89af6-31ed-4340-b935-8f577af0f9d0 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:35.883943 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.quota [None req-1cb89af6-31ed-4340-b935-8f577af0f9d0 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Getting quotas for project 17c28a2aaa4b4d4bada90cea2b8ccff5. Resources: {'instances', 'cores', 'ram'} {{(pid=117884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 22 11:22:35.888278 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.quota [None req-1cb89af6-31ed-4340-b935-8f577af0f9d0 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Getting quotas for user 2e46f6bf93bf4e839a0dfebd5409f32e and project 17c28a2aaa4b4d4bada90cea2b8ccff5. Resources: {'instances', 'cores', 'ram'} {{(pid=117884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 22 11:22:35.900592 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-1cb89af6-31ed-4340-b935-8f577af0f9d0 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Going to run 1 instances... {{(pid=117884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 22 11:22:35.902967 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-1cb89af6-31ed-4340-b935-8f577af0f9d0 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] [instance: cb59f025-efd2-49c0-b90c-ce951e3d2d94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1a6c3cb4-9f56-44c6-aa68-01000df27209',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 22 11:22:35.954555 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-1cb89af6-31ed-4340-b935-8f577af0f9d0 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.631652 Jul 22 11:22:35.955434 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 484/983] 10.222.0.20 () {60 vars in 1146 bytes} [Fri Jul 22 11:22:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 633 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 22 11:22:35.965817 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-bff9ce94-649a-4c9f-8291-90f4a523cbac tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:22:35.966430 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-bff9ce94-649a-4c9f-8291-90f4a523cbac tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] [instance: cb59f025-efd2-49c0-b90c-ce951e3d2d94] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:22:36.028302 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-bff9ce94-649a-4c9f-8291-90f4a523cbac tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e46f6bf93bf4e839a0dfebd5409f32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c28a2aaa4b4d4bada90cea2b8ccff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:22:36.037648 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-bff9ce94-649a-4c9f-8291-90f4a523cbac tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] 10.222.0.20 "GET /compute/v2.1/servers/cb59f025-efd2-49c0-b90c-ce951e3d2d94" status: 200 len: 1214 microversion: 2.1 time: 0.075690 Jul 22 11:22:36.038614 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 500/984] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:22:35 2022] GET /compute/v2.1/servers/cb59f025-efd2-49c0-b90c-ce951e3d2d94 => generated 1214 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:22:36.881993 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-5765a022-85b6-4a55-a827-c20a56f773ea tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:22:36.883011 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-5765a022-85b6-4a55-a827-c20a56f773ea tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] [instance: 20ac1d4f-6e62-4639-a857-268f248e6663] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:22:36.892632 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-5765a022-85b6-4a55-a827-c20a56f773ea tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:36.893091 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-5765a022-85b6-4a55-a827-c20a56f773ea tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:36.893855 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-5765a022-85b6-4a55-a827-c20a56f773ea tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:36.894291 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-5765a022-85b6-4a55-a827-c20a56f773ea tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:37.056489 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-132e075d-056c-4a60-b7d7-5a73c9b62548 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:22:37.057590 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-132e075d-056c-4a60-b7d7-5a73c9b62548 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] [instance: cb59f025-efd2-49c0-b90c-ce951e3d2d94] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:22:37.058527 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-5765a022-85b6-4a55-a827-c20a56f773ea tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6bfa46cc3849d2a9b11fd41912722e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8f2050ff1d48c7871edba63439e007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:22:37.065752 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-132e075d-056c-4a60-b7d7-5a73c9b62548 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:37.066902 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-132e075d-056c-4a60-b7d7-5a73c9b62548 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:37.068278 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-132e075d-056c-4a60-b7d7-5a73c9b62548 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:37.069488 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-132e075d-056c-4a60-b7d7-5a73c9b62548 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:37.071548 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-5765a022-85b6-4a55-a827-c20a56f773ea tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] 10.222.0.20 "GET /compute/v2.1/servers/20ac1d4f-6e62-4639-a857-268f248e6663" status: 200 len: 1471 microversion: 2.1 time: 0.195888 Jul 22 11:22:37.073010 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 485/985] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:22:36 2022] GET /compute/v2.1/servers/20ac1d4f-6e62-4639-a857-268f248e6663 => generated 1471 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:22:37.144002 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-132e075d-056c-4a60-b7d7-5a73c9b62548 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e46f6bf93bf4e839a0dfebd5409f32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c28a2aaa4b4d4bada90cea2b8ccff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:22:37.154820 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-132e075d-056c-4a60-b7d7-5a73c9b62548 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] 10.222.0.20 "GET /compute/v2.1/servers/cb59f025-efd2-49c0-b90c-ce951e3d2d94" status: 200 len: 1210 microversion: 2.1 time: 0.102841 Jul 22 11:22:37.155455 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 501/986] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:22:37 2022] GET /compute/v2.1/servers/cb59f025-efd2-49c0-b90c-ce951e3d2d94 => generated 1210 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:22:38.097645 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-050a97e9-3a9c-49a4-af3b-a402d3570e6d tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:22:38.098378 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-050a97e9-3a9c-49a4-af3b-a402d3570e6d tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] [instance: 20ac1d4f-6e62-4639-a857-268f248e6663] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:22:38.107516 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-050a97e9-3a9c-49a4-af3b-a402d3570e6d tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:38.108432 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-050a97e9-3a9c-49a4-af3b-a402d3570e6d tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:38.110374 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-050a97e9-3a9c-49a4-af3b-a402d3570e6d tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:38.111067 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-050a97e9-3a9c-49a4-af3b-a402d3570e6d tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:38.175027 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-5d3b5e7c-acf0-4ed2-abbb-aaf161cbbbbe tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:22:38.175775 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-5d3b5e7c-acf0-4ed2-abbb-aaf161cbbbbe tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] [instance: cb59f025-efd2-49c0-b90c-ce951e3d2d94] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:22:38.186983 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5d3b5e7c-acf0-4ed2-abbb-aaf161cbbbbe tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:38.187552 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5d3b5e7c-acf0-4ed2-abbb-aaf161cbbbbe tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:38.188409 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5d3b5e7c-acf0-4ed2-abbb-aaf161cbbbbe tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:38.188915 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5d3b5e7c-acf0-4ed2-abbb-aaf161cbbbbe tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:38.266590 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-5d3b5e7c-acf0-4ed2-abbb-aaf161cbbbbe tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e46f6bf93bf4e839a0dfebd5409f32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c28a2aaa4b4d4bada90cea2b8ccff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:22:38.282585 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-5d3b5e7c-acf0-4ed2-abbb-aaf161cbbbbe tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] 10.222.0.20 "GET /compute/v2.1/servers/cb59f025-efd2-49c0-b90c-ce951e3d2d94" status: 200 len: 1272 microversion: 2.1 time: 0.113301 Jul 22 11:22:38.283510 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 502/987] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:22:38 2022] GET /compute/v2.1/servers/cb59f025-efd2-49c0-b90c-ce951e3d2d94 => generated 1272 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:22:38.466915 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-cb9ae909-89a6-4ea1-81c0-3bd0bc71cd19 req-e57abb50-ad93-4d71-9a5c-2cb8a0557e1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20ac1d4f-6e62-4639-a857-268f248e6663", "name": "network-vif-deleted", "tag": "332966ad-58ca-47a0-91ea-36872b984bf3"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:22:38.473451 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-050a97e9-3a9c-49a4-af3b-a402d3570e6d tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6bfa46cc3849d2a9b11fd41912722e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8f2050ff1d48c7871edba63439e007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:22:38.484988 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-050a97e9-3a9c-49a4-af3b-a402d3570e6d tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] 10.222.0.20 "GET /compute/v2.1/servers/20ac1d4f-6e62-4639-a857-268f248e6663" status: 200 len: 1471 microversion: 2.1 time: 0.393641 Jul 22 11:22:38.487018 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-cb9ae909-89a6-4ea1-81c0-3bd0bc71cd19 req-e57abb50-ad93-4d71-9a5c-2cb8a0557e1e service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:38.488435 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-cb9ae909-89a6-4ea1-81c0-3bd0bc71cd19 req-e57abb50-ad93-4d71-9a5c-2cb8a0557e1e service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:38.497445 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 486/988] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:22:38 2022] GET /compute/v2.1/servers/20ac1d4f-6e62-4639-a857-268f248e6663 => generated 1471 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:22:38.510387 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-cb9ae909-89a6-4ea1-81c0-3bd0bc71cd19 req-e57abb50-ad93-4d71-9a5c-2cb8a0557e1e service nova] Creating event network-vif-deleted:332966ad-58ca-47a0-91ea-36872b984bf3 for instance 20ac1d4f-6e62-4639-a857-268f248e6663 on hv-cinder-84890 Jul 22 11:22:38.520575 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-cb9ae909-89a6-4ea1-81c0-3bd0bc71cd19 req-e57abb50-ad93-4d71-9a5c-2cb8a0557e1e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062904 Jul 22 11:22:38.522315 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 503/989] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:22:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:22:39.300897 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-2afdd83d-0886-48df-8ba8-84185e60d12e tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:22:39.302532 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-2afdd83d-0886-48df-8ba8-84185e60d12e tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] [instance: cb59f025-efd2-49c0-b90c-ce951e3d2d94] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:22:39.308695 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-2afdd83d-0886-48df-8ba8-84185e60d12e tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:39.309162 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-2afdd83d-0886-48df-8ba8-84185e60d12e tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:39.309957 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-2afdd83d-0886-48df-8ba8-84185e60d12e tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:39.310395 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-2afdd83d-0886-48df-8ba8-84185e60d12e tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:39.516559 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-e85b8808-2005-49d7-8d27-d9b5a38471ea tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:22:39.517330 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-e85b8808-2005-49d7-8d27-d9b5a38471ea tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] [instance: 20ac1d4f-6e62-4639-a857-268f248e6663] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:22:39.523707 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e85b8808-2005-49d7-8d27-d9b5a38471ea tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:39.524155 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e85b8808-2005-49d7-8d27-d9b5a38471ea tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:39.524927 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e85b8808-2005-49d7-8d27-d9b5a38471ea tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:39.525359 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e85b8808-2005-49d7-8d27-d9b5a38471ea tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:39.539242 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.wsgi [None req-e85b8808-2005-49d7-8d27-d9b5a38471ea tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] HTTP exception thrown: Instance 20ac1d4f-6e62-4639-a857-268f248e6663 could not be found. Jul 22 11:22:39.540963 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-e85b8808-2005-49d7-8d27-d9b5a38471ea tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Request method failure captured: Jul 22 11:22:39.540963 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: request: GET /compute/v2.1/servers/20ac1d4f-6e62-4639-a857-268f248e6663 HTTP/1.1 Jul 22 11:22:39.540963 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Accept: application/json Jul 22 11:22:39.540963 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Accept-Encoding: identity Jul 22 11:22:39.540963 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Connection: close Jul 22 11:22:39.540963 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Content-Length: 0 Jul 22 11:22:39.540963 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Content-Type: application/json Jul 22 11:22:39.540963 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Host: 10.222.0.20 Jul 22 11:22:39.540963 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Openstack-System-Scope: None Jul 22 11:22:39.540963 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: User-Agent: python-urllib3/1.26.9 Jul 22 11:22:39.540963 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Auth-Token: gAAAAABi2ohrsb5RJx9LaWKFvtRiPhyu0h2Fv5xQG9Ol-4Gs3HMpia-VmOEtscGBq6MRV1BI10CZh5LXJHbr_fjfX-K76HSGKSOYMhsvEY8Ra2ZGLP49LLsyoOwUjFZrHmJuSkx8UkqbMUguXm2n6qB6bj2q_eCSeLsb7DWtmfrHHVroKKXVP_4 Jul 22 11:22:39.540963 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Domain-Id: None Jul 22 11:22:39.540963 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Domain-Name: None Jul 22 11:22:39.540963 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Identity-Status: Confirmed Jul 22 11:22:39.540963 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Is-Admin-Project: True Jul 22 11:22:39.540963 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Project-Domain-Id: default Jul 22 11:22:39.540963 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Project-Domain-Name: Default Jul 22 11:22:39.540963 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Project-Id: ee8f2050ff1d48c7871edba63439e007 Jul 22 11:22:39.540963 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Project-Name: tempest-VolumesNegativeTest-348771286 Jul 22 11:22:39.540963 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Role: reader,member Jul 22 11:22:39.540963 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Roles: reader,member Jul 22 11:22:39.542517 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ee8f2050ff1d48c7871edba63439e007"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ee8f2050ff1d48c7871edba63439e007", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ee8f2050ff1d48c7871edba63439e007"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ee8f2050ff1d48c7871edba63439e007"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jul 22 11:22:39.542517 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Tenant: tempest-VolumesNegativeTest-348771286 Jul 22 11:22:39.542517 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Tenant-Id: ee8f2050ff1d48c7871edba63439e007 Jul 22 11:22:39.542517 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Tenant-Name: tempest-VolumesNegativeTest-348771286 Jul 22 11:22:39.542517 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User: tempest-VolumesNegativeTest-348771286-project Jul 22 11:22:39.542517 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User-Domain-Id: default Jul 22 11:22:39.542517 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User-Domain-Name: Default Jul 22 11:22:39.542517 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User-Id: 5b6bfa46cc3849d2a9b11fd41912722e Jul 22 11:22:39.542517 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User-Name: tempest-VolumesNegativeTest-348771286-project Jul 22 11:22:39.542517 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: method: > Jul 22 11:22:39.542517 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: exception: Instance 20ac1d4f-6e62-4639-a857-268f248e6663 could not be found. Jul 22 11:22:39.542517 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: action_args: {'id': '20ac1d4f-6e62-4639-a857-268f248e6663'} Jul 22 11:22:39.543471 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 22 11:22:39.543471 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:22:39.543471 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 22 11:22:39.543471 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 22 11:22:39.543471 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 22 11:22:39.543471 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 22 11:22:39.543471 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 22 11:22:39.543471 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 22 11:22:39.543471 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 22 11:22:39.543471 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 22 11:22:39.543471 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20ac1d4f-6e62-4639-a857-268f248e6663 could not be found. Jul 22 11:22:39.543471 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:22:39.543471 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:22:39.543471 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:22:39.543471 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:22:39.543471 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:22:39.543471 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:22:39.543471 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 22 11:22:39.543471 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 22 11:22:39.543471 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 22 11:22:39.545546 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 22 11:22:39.545546 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 22 11:22:39.545546 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 22 11:22:39.545546 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 22 11:22:39.545546 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 22 11:22:39.545546 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 22 11:22:39.545546 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 22 11:22:39.545546 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20ac1d4f-6e62-4639-a857-268f248e6663 could not be found. Jul 22 11:22:39.545546 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:22:39.545546 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:22:39.545546 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:22:39.545546 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:22:39.545546 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:22:39.545546 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:22:39.545546 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 22 11:22:39.545546 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 22 11:22:39.545546 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20ac1d4f-6e62-4639-a857-268f248e6663 could not be found. Jul 22 11:22:39.545546 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:22:39.547196 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-e85b8808-2005-49d7-8d27-d9b5a38471ea tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] Returning 404 to user: Instance 20ac1d4f-6e62-4639-a857-268f248e6663 could not be found. {{(pid=117885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 22 11:22:39.547196 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-e85b8808-2005-49d7-8d27-d9b5a38471ea tempest-VolumesNegativeTest-348771286 tempest-VolumesNegativeTest-348771286-project] 10.222.0.20 "GET /compute/v2.1/servers/20ac1d4f-6e62-4639-a857-268f248e6663" status: 404 len: 111 microversion: 2.1 time: 0.030610 Jul 22 11:22:39.547390 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 504/990] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:22:39 2022] GET /compute/v2.1/servers/20ac1d4f-6e62-4639-a857-268f248e6663 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 22 11:22:39.674663 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-2afdd83d-0886-48df-8ba8-84185e60d12e tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e46f6bf93bf4e839a0dfebd5409f32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c28a2aaa4b4d4bada90cea2b8ccff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:22:39.678818 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG dbcounter [-] [117884] Writing DB stats nova_cell1:SELECT=100 {{(pid=117884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:22:39.685231 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-2afdd83d-0886-48df-8ba8-84185e60d12e tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] 10.222.0.20 "GET /compute/v2.1/servers/cb59f025-efd2-49c0-b90c-ce951e3d2d94" status: 200 len: 1314 microversion: 2.1 time: 0.387982 Jul 22 11:22:39.685823 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 487/991] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:22:39 2022] GET /compute/v2.1/servers/cb59f025-efd2-49c0-b90c-ce951e3d2d94 => generated 1314 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:22:40.571173 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-ed310d58-86a8-474c-83c7-8bdecc9034af req-70d9ac08-9e3c-46d5-835f-a3db8b5956ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb59f025-efd2-49c0-b90c-ce951e3d2d94", "tag": "238bb944-cf08-41f6-ae54-94b8537277a0"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:22:40.582497 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-ed310d58-86a8-474c-83c7-8bdecc9034af req-70d9ac08-9e3c-46d5-835f-a3db8b5956ec service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:40.582947 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-ed310d58-86a8-474c-83c7-8bdecc9034af req-70d9ac08-9e3c-46d5-835f-a3db8b5956ec service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:40.596480 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-ed310d58-86a8-474c-83c7-8bdecc9034af req-70d9ac08-9e3c-46d5-835f-a3db8b5956ec service nova] Creating event network-changed:238bb944-cf08-41f6-ae54-94b8537277a0 for instance cb59f025-efd2-49c0-b90c-ce951e3d2d94 on hv-cinder-84890 Jul 22 11:22:40.602466 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-ed310d58-86a8-474c-83c7-8bdecc9034af req-70d9ac08-9e3c-46d5-835f-a3db8b5956ec service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035418 Jul 22 11:22:40.603431 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 505/992] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:22:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 22 11:22:40.717584 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-b4ea492e-8bb9-46e6-a341-b0dae67f06c1 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:22:40.719492 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-b4ea492e-8bb9-46e6-a341-b0dae67f06c1 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] [instance: cb59f025-efd2-49c0-b90c-ce951e3d2d94] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:22:40.726861 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-b4ea492e-8bb9-46e6-a341-b0dae67f06c1 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:40.727338 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-b4ea492e-8bb9-46e6-a341-b0dae67f06c1 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:40.728126 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-b4ea492e-8bb9-46e6-a341-b0dae67f06c1 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:40.728566 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-b4ea492e-8bb9-46e6-a341-b0dae67f06c1 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:40.886757 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-b4ea492e-8bb9-46e6-a341-b0dae67f06c1 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e46f6bf93bf4e839a0dfebd5409f32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c28a2aaa4b4d4bada90cea2b8ccff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:22:40.894405 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-b4ea492e-8bb9-46e6-a341-b0dae67f06c1 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] 10.222.0.20 "GET /compute/v2.1/servers/cb59f025-efd2-49c0-b90c-ce951e3d2d94" status: 200 len: 1314 microversion: 2.1 time: 0.181615 Jul 22 11:22:40.894977 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 488/993] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:22:40 2022] GET /compute/v2.1/servers/cb59f025-efd2-49c0-b90c-ce951e3d2d94 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:22:41.913590 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-c8efc772-2745-4902-8e7e-879797eaaf4e tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:22:41.915189 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-c8efc772-2745-4902-8e7e-879797eaaf4e tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] [instance: cb59f025-efd2-49c0-b90c-ce951e3d2d94] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:22:41.922975 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c8efc772-2745-4902-8e7e-879797eaaf4e tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:41.923714 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c8efc772-2745-4902-8e7e-879797eaaf4e tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:41.924651 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c8efc772-2745-4902-8e7e-879797eaaf4e tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:41.925252 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c8efc772-2745-4902-8e7e-879797eaaf4e tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:42.092651 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-c8efc772-2745-4902-8e7e-879797eaaf4e tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e46f6bf93bf4e839a0dfebd5409f32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c28a2aaa4b4d4bada90cea2b8ccff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:22:42.101088 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-c8efc772-2745-4902-8e7e-879797eaaf4e tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] 10.222.0.20 "GET /compute/v2.1/servers/cb59f025-efd2-49c0-b90c-ce951e3d2d94" status: 200 len: 1314 microversion: 2.1 time: 0.191673 Jul 22 11:22:42.101955 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 506/994] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:22:41 2022] GET /compute/v2.1/servers/cb59f025-efd2-49c0-b90c-ce951e3d2d94 => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:22:42.584766 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-6fb4b182-8cf9-46bf-b39b-2de5d0dbf641 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:22:42.585749 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-6fb4b182-8cf9-46bf-b39b-2de5d0dbf641 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:22:42.603013 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-6fb4b182-8cf9-46bf-b39b-2de5d0dbf641 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:42.603500 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-6fb4b182-8cf9-46bf-b39b-2de5d0dbf641 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:42.604319 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-6fb4b182-8cf9-46bf-b39b-2de5d0dbf641 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:42.604744 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-6fb4b182-8cf9-46bf-b39b-2de5d0dbf641 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:42.653987 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-6fb4b182-8cf9-46bf-b39b-2de5d0dbf641 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.072804 Jul 22 11:22:42.655005 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 489/995] 10.222.0.20 () {60 vars in 1342 bytes} [Fri Jul 22 11:22:42 2022] GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46/os-volume_attachments => generated 25 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:22:42.731711 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-3923a672-c0ba-4a0f-bafd-7a98105d13e6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:22:42.732242 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-3923a672-c0ba-4a0f-bafd-7a98105d13e6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:22:42.739001 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3923a672-c0ba-4a0f-bafd-7a98105d13e6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:42.739749 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3923a672-c0ba-4a0f-bafd-7a98105d13e6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:42.740546 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3923a672-c0ba-4a0f-bafd-7a98105d13e6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:42.740947 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3923a672-c0ba-4a0f-bafd-7a98105d13e6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:42.766713 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-3923a672-c0ba-4a0f-bafd-7a98105d13e6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46] Going to try to terminate instance {{(pid=117885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 22 11:22:42.846460 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-3923a672-c0ba-4a0f-bafd-7a98105d13e6 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46" status: 204 len: 0 microversion: 2.20 time: 0.120559 Jul 22 11:22:42.847474 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 507/996] 10.222.0.20 () {60 vars in 1279 bytes} [Fri Jul 22 11:22:42 2022] DELETE /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 22 11:22:42.858359 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-30a6cfa8-209f-40c2-8d24-8caf6ad8b5dd tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:22:42.860481 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-30a6cfa8-209f-40c2-8d24-8caf6ad8b5dd tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:22:42.868876 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-30a6cfa8-209f-40c2-8d24-8caf6ad8b5dd tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:42.869468 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-30a6cfa8-209f-40c2-8d24-8caf6ad8b5dd tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:42.870350 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-30a6cfa8-209f-40c2-8d24-8caf6ad8b5dd tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:42.870874 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-30a6cfa8-209f-40c2-8d24-8caf6ad8b5dd tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:43.026426 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-30a6cfa8-209f-40c2-8d24-8caf6ad8b5dd tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:22:43.036356 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-30a6cfa8-209f-40c2-8d24-8caf6ad8b5dd tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:22:43.037819 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-30a6cfa8-209f-40c2-8d24-8caf6ad8b5dd tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:22:43.039348 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-30a6cfa8-209f-40c2-8d24-8caf6ad8b5dd tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46" status: 200 len: 1724 microversion: 2.20 time: 0.186419 Jul 22 11:22:43.040162 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 490/997] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:22:42 2022] GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 => generated 1724 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:22:43.119050 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-ef772341-9e37-4916-afa7-39ba9d98a1fd tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:22:43.119775 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-ef772341-9e37-4916-afa7-39ba9d98a1fd tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] [instance: cb59f025-efd2-49c0-b90c-ce951e3d2d94] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:22:43.126328 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ef772341-9e37-4916-afa7-39ba9d98a1fd tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:43.126774 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ef772341-9e37-4916-afa7-39ba9d98a1fd tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:43.127584 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ef772341-9e37-4916-afa7-39ba9d98a1fd tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:43.128011 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ef772341-9e37-4916-afa7-39ba9d98a1fd tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:43.268088 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-ef772341-9e37-4916-afa7-39ba9d98a1fd tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e46f6bf93bf4e839a0dfebd5409f32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c28a2aaa4b4d4bada90cea2b8ccff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:22:43.275981 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-ef772341-9e37-4916-afa7-39ba9d98a1fd tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] 10.222.0.20 "GET /compute/v2.1/servers/cb59f025-efd2-49c0-b90c-ce951e3d2d94" status: 200 len: 1314 microversion: 2.1 time: 0.161392 Jul 22 11:22:43.276571 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 508/998] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:22:43 2022] GET /compute/v2.1/servers/cb59f025-efd2-49c0-b90c-ce951e3d2d94 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:22:44.062341 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-dd571bb0-824b-4fdf-a4c6-03d3cbcd1e4b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:22:44.063289 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-dd571bb0-824b-4fdf-a4c6-03d3cbcd1e4b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:22:44.070732 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-dd571bb0-824b-4fdf-a4c6-03d3cbcd1e4b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:44.072675 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-dd571bb0-824b-4fdf-a4c6-03d3cbcd1e4b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:44.072675 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-dd571bb0-824b-4fdf-a4c6-03d3cbcd1e4b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:44.072675 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-dd571bb0-824b-4fdf-a4c6-03d3cbcd1e4b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:44.258321 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-dd571bb0-824b-4fdf-a4c6-03d3cbcd1e4b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:22:44.270776 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-dd571bb0-824b-4fdf-a4c6-03d3cbcd1e4b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:22:44.273461 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-dd571bb0-824b-4fdf-a4c6-03d3cbcd1e4b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:22:44.275490 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-dd571bb0-824b-4fdf-a4c6-03d3cbcd1e4b tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46" status: 200 len: 1724 microversion: 2.20 time: 0.220022 Jul 22 11:22:44.276833 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 491/999] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:22:44 2022] GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 => generated 1724 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 22 11:22:44.294139 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-52422794-841e-4e4f-99ee-4a258c2ccd9e tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:22:44.295155 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-52422794-841e-4e4f-99ee-4a258c2ccd9e tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] [instance: cb59f025-efd2-49c0-b90c-ce951e3d2d94] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:22:44.302913 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-52422794-841e-4e4f-99ee-4a258c2ccd9e tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:44.303470 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-52422794-841e-4e4f-99ee-4a258c2ccd9e tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:44.304292 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-52422794-841e-4e4f-99ee-4a258c2ccd9e tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:44.306914 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-52422794-841e-4e4f-99ee-4a258c2ccd9e tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:44.524363 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-52422794-841e-4e4f-99ee-4a258c2ccd9e tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e46f6bf93bf4e839a0dfebd5409f32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c28a2aaa4b4d4bada90cea2b8ccff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:22:44.536568 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-52422794-841e-4e4f-99ee-4a258c2ccd9e tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] 10.222.0.20 "GET /compute/v2.1/servers/cb59f025-efd2-49c0-b90c-ce951e3d2d94" status: 200 len: 1314 microversion: 2.1 time: 0.246139 Jul 22 11:22:44.537682 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 509/1000] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:22:44 2022] GET /compute/v2.1/servers/cb59f025-efd2-49c0-b90c-ce951e3d2d94 => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:22:45.298142 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-2362680c-2eae-422e-94bd-9e421f206535 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:22:45.299053 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-2362680c-2eae-422e-94bd-9e421f206535 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:22:45.306503 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-2362680c-2eae-422e-94bd-9e421f206535 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:45.306944 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-2362680c-2eae-422e-94bd-9e421f206535 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:45.308319 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-2362680c-2eae-422e-94bd-9e421f206535 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:45.308932 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-2362680c-2eae-422e-94bd-9e421f206535 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:45.405859 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-2362680c-2eae-422e-94bd-9e421f206535 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:22:45.416964 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-2362680c-2eae-422e-94bd-9e421f206535 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:22:45.418463 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-2362680c-2eae-422e-94bd-9e421f206535 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99798aca08904bc787f5d0afee8d0ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b745569c01e04aa18f5494b0856bc3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:22:45.419691 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-2362680c-2eae-422e-94bd-9e421f206535 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46" status: 200 len: 1656 microversion: 2.20 time: 0.126471 Jul 22 11:22:45.420261 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 492/1001] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:22:45 2022] GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 => generated 1656 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 11:22:45.560477 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-b75640bb-4e43-47a5-97b4-f35409aebcc2 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:22:45.563030 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-b75640bb-4e43-47a5-97b4-f35409aebcc2 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] [instance: cb59f025-efd2-49c0-b90c-ce951e3d2d94] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:22:45.585349 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [req-864a6628-47b9-44d6-8c12-7277d0738220 req-b4632343-76ba-4f47-879d-07e080f6ce4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46", "name": "network-vif-deleted", "tag": "c1ac6e13-743e-4cd7-b970-2f05998ba958"}]} {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:22:45.595923 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-864a6628-47b9-44d6-8c12-7277d0738220 req-b4632343-76ba-4f47-879d-07e080f6ce4b service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:45.596825 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-864a6628-47b9-44d6-8c12-7277d0738220 req-b4632343-76ba-4f47-879d-07e080f6ce4b service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:45.597840 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b75640bb-4e43-47a5-97b4-f35409aebcc2 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:45.599852 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b75640bb-4e43-47a5-97b4-f35409aebcc2 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:45.600878 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b75640bb-4e43-47a5-97b4-f35409aebcc2 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:45.603276 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b75640bb-4e43-47a5-97b4-f35409aebcc2 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:45.630507 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.compute.server_external_events [req-864a6628-47b9-44d6-8c12-7277d0738220 req-b4632343-76ba-4f47-879d-07e080f6ce4b service nova] Creating event network-vif-deleted:c1ac6e13-743e-4cd7-b970-2f05998ba958 for instance f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 on hv-cinder-84890 Jul 22 11:22:45.651771 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [req-864a6628-47b9-44d6-8c12-7277d0738220 req-b4632343-76ba-4f47-879d-07e080f6ce4b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057420 Jul 22 11:22:45.658347 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 493/1002] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:22:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 22 11:22:45.948980 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-b75640bb-4e43-47a5-97b4-f35409aebcc2 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e46f6bf93bf4e839a0dfebd5409f32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c28a2aaa4b4d4bada90cea2b8ccff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:22:45.960799 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-b75640bb-4e43-47a5-97b4-f35409aebcc2 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] 10.222.0.20 "GET /compute/v2.1/servers/cb59f025-efd2-49c0-b90c-ce951e3d2d94" status: 200 len: 1314 microversion: 2.1 time: 0.405195 Jul 22 11:22:45.961680 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 510/1003] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:22:45 2022] GET /compute/v2.1/servers/cb59f025-efd2-49c0-b90c-ce951e3d2d94 => generated 1314 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:22:46.435815 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG dbcounter [-] [117884] Writing DB stats nova_cell0:SELECT=2 {{(pid=117884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:22:46.436725 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG dbcounter [-] [117884] Writing DB stats nova_cell0:SELECT=6 {{(pid=117884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:22:46.441643 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-d88d717f-90a0-486a-ba4a-880234c1cbee tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:22:46.442850 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-d88d717f-90a0-486a-ba4a-880234c1cbee tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:22:46.445684 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG dbcounter [-] [117884] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=117884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:22:46.451014 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-d88d717f-90a0-486a-ba4a-880234c1cbee tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:46.451672 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-d88d717f-90a0-486a-ba4a-880234c1cbee tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:46.452651 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-d88d717f-90a0-486a-ba4a-880234c1cbee tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:46.453166 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-d88d717f-90a0-486a-ba4a-880234c1cbee tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:46.472364 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.wsgi [None req-d88d717f-90a0-486a-ba4a-880234c1cbee tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] HTTP exception thrown: Instance f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 could not be found. Jul 22 11:22:46.474143 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-d88d717f-90a0-486a-ba4a-880234c1cbee tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Request method failure captured: Jul 22 11:22:46.474143 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: request: GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 HTTP/1.1 Jul 22 11:22:46.474143 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Accept: application/json Jul 22 11:22:46.474143 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Accept-Encoding: identity Jul 22 11:22:46.474143 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Connection: close Jul 22 11:22:46.474143 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Content-Length: 0 Jul 22 11:22:46.474143 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Content-Type: application/json Jul 22 11:22:46.474143 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Host: 10.222.0.20 Jul 22 11:22:46.474143 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Openstack-System-Scope: None Jul 22 11:22:46.474143 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: User-Agent: python-urllib3/1.26.9 Jul 22 11:22:46.474143 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Auth-Token: gAAAAABi2obkhLpwbPo8iCLViqoRP4IeqdCwt1UHm93yMDr_ne3LjF1_ecp2T8W8QtG5lp9yZAFjJojTvSrVywgsc-2Op4HesUZh2kcKDqDesLMRM36Pis_iVc7Es_mx9guoLwx8h0hAfY2dCZtZsS0tza2GEjm1Ji4suovm5RuuKLKZcM8dy5k Jul 22 11:22:46.474143 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Domain-Id: None Jul 22 11:22:46.474143 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Domain-Name: None Jul 22 11:22:46.474143 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Identity-Status: Confirmed Jul 22 11:22:46.474143 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Is-Admin-Project: True Jul 22 11:22:46.474143 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Openstack-Nova-Api-Version: 2.20 Jul 22 11:22:46.474143 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Domain-Id: default Jul 22 11:22:46.474143 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Domain-Name: Default Jul 22 11:22:46.474143 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Id: b745569c01e04aa18f5494b0856bc3d1 Jul 22 11:22:46.474143 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-101294574 Jul 22 11:22:46.474143 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Role: reader,member Jul 22 11:22:46.474143 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Roles: reader,member Jul 22 11:22:46.475920 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b745569c01e04aa18f5494b0856bc3d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b745569c01e04aa18f5494b0856bc3d1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b745569c01e04aa18f5494b0856bc3d1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b745569c01e04aa18f5494b0856bc3d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jul 22 11:22:46.475920 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant: tempest-AttachVolumeShelveTestJSON-101294574 Jul 22 11:22:46.475920 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant-Id: b745569c01e04aa18f5494b0856bc3d1 Jul 22 11:22:46.475920 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-101294574 Jul 22 11:22:46.475920 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User: tempest-AttachVolumeShelveTestJSON-101294574-project Jul 22 11:22:46.475920 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Domain-Id: default Jul 22 11:22:46.475920 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Domain-Name: Default Jul 22 11:22:46.475920 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Id: 99798aca08904bc787f5d0afee8d0ac7 Jul 22 11:22:46.475920 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Name: tempest-AttachVolumeShelveTestJSON-101294574-project Jul 22 11:22:46.475920 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: method: > Jul 22 11:22:46.475920 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: exception: Instance f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 could not be found. Jul 22 11:22:46.475920 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: action_args: {'id': 'f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46'} Jul 22 11:22:46.476881 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 22 11:22:46.476881 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:22:46.476881 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 22 11:22:46.476881 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 22 11:22:46.476881 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 22 11:22:46.476881 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 22 11:22:46.476881 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 22 11:22:46.476881 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 22 11:22:46.476881 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 22 11:22:46.476881 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 22 11:22:46.476881 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 could not be found. Jul 22 11:22:46.476881 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:22:46.476881 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:22:46.476881 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:22:46.476881 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:22:46.476881 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:22:46.476881 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:22:46.476881 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 22 11:22:46.476881 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 22 11:22:46.476881 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 22 11:22:46.478377 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 22 11:22:46.478377 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 22 11:22:46.478377 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 22 11:22:46.478377 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 22 11:22:46.478377 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 22 11:22:46.478377 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 22 11:22:46.478377 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 22 11:22:46.478377 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 could not be found. Jul 22 11:22:46.478377 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:22:46.478377 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:22:46.478377 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:22:46.478377 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:22:46.478377 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:22:46.478377 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:22:46.478377 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 22 11:22:46.478377 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 22 11:22:46.478377 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 could not be found. Jul 22 11:22:46.478377 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:22:46.482195 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-d88d717f-90a0-486a-ba4a-880234c1cbee tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Returning 404 to user: Instance f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 could not be found. {{(pid=117884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 22 11:22:46.482195 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-d88d717f-90a0-486a-ba4a-880234c1cbee tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46" status: 404 len: 111 microversion: 2.20 time: 0.042543 Jul 22 11:22:46.482445 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 494/1004] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:22:46 2022] GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 22 11:22:46.488776 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-63de340f-8b47-4b18-b0a7-99cabf7d08a4 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '.version_select at 0x7f84451db310>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:22:46.492543 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell0:SELECT=2 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:22:46.516839 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-63de340f-8b47-4b18-b0a7-99cabf7d08a4 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-289085626" status: 204 len: 0 microversion: 2.20 time: 0.032758 Jul 22 11:22:46.517458 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 511/1005] 10.222.0.20 () {60 vars in 1258 bytes} [Fri Jul 22 11:22:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-289085626 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 22 11:22:46.961844 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [req-df82e7dd-8eff-4c3f-be48-0de3fc8233bb req-364ffcc6-a90d-40c1-8e4f-68387529e421 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb59f025-efd2-49c0-b90c-ce951e3d2d94", "name": "network-vif-plugged", "status": "completed", "tag": "238bb944-cf08-41f6-ae54-94b8537277a0"}]} {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:22:46.973294 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-df82e7dd-8eff-4c3f-be48-0de3fc8233bb req-364ffcc6-a90d-40c1-8e4f-68387529e421 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:46.973294 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-df82e7dd-8eff-4c3f-be48-0de3fc8233bb req-364ffcc6-a90d-40c1-8e4f-68387529e421 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:46.979172 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-a9d2dbea-88da-49fb-804c-f30cbadf74a3 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:22:46.979973 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-a9d2dbea-88da-49fb-804c-f30cbadf74a3 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] [instance: cb59f025-efd2-49c0-b90c-ce951e3d2d94] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:22:46.990851 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a9d2dbea-88da-49fb-804c-f30cbadf74a3 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:46.992358 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a9d2dbea-88da-49fb-804c-f30cbadf74a3 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:46.994407 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a9d2dbea-88da-49fb-804c-f30cbadf74a3 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:46.995234 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a9d2dbea-88da-49fb-804c-f30cbadf74a3 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:47.011279 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.compute.server_external_events [req-df82e7dd-8eff-4c3f-be48-0de3fc8233bb req-364ffcc6-a90d-40c1-8e4f-68387529e421 service nova] Creating event network-vif-plugged:238bb944-cf08-41f6-ae54-94b8537277a0 for instance cb59f025-efd2-49c0-b90c-ce951e3d2d94 on hv-cinder-84890 Jul 22 11:22:47.025012 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [req-df82e7dd-8eff-4c3f-be48-0de3fc8233bb req-364ffcc6-a90d-40c1-8e4f-68387529e421 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076097 Jul 22 11:22:47.025998 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 495/1006] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:22:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:22:47.258110 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-a9d2dbea-88da-49fb-804c-f30cbadf74a3 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e46f6bf93bf4e839a0dfebd5409f32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c28a2aaa4b4d4bada90cea2b8ccff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:22:47.274236 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-a9d2dbea-88da-49fb-804c-f30cbadf74a3 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] 10.222.0.20 "GET /compute/v2.1/servers/cb59f025-efd2-49c0-b90c-ce951e3d2d94" status: 200 len: 1314 microversion: 2.1 time: 0.299144 Jul 22 11:22:47.276853 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 512/1007] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:22:46 2022] GET /compute/v2.1/servers/cb59f025-efd2-49c0-b90c-ce951e3d2d94 => generated 1314 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:22:48.058865 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-7cd4cd9e-0cf8-4900-9068-f9291b8a584d tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1436327171", "imageRef": "1a6c3cb4-9f56-44c6-aa68-01000df27209", "flavorRef": "452", "networks": [{"uuid": "21334fc9-8075-4597-ace1-e64a29a68fe1"}]}} {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:22:48.112102 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.network.neutron [None req-7cd4cd9e-0cf8-4900-9068-f9291b8a584d tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] validate_networks() for [('21334fc9-8075-4597-ace1-e64a29a68fe1', None, None, None, None, None)] {{(pid=117884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 22 11:22:48.293833 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-d7749330-afa1-443c-8959-d2199fdb84d0 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:22:48.294364 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-d7749330-afa1-443c-8959-d2199fdb84d0 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] [instance: cb59f025-efd2-49c0-b90c-ce951e3d2d94] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:22:48.303704 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d7749330-afa1-443c-8959-d2199fdb84d0 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:48.304465 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d7749330-afa1-443c-8959-d2199fdb84d0 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:48.305619 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d7749330-afa1-443c-8959-d2199fdb84d0 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:48.306066 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d7749330-afa1-443c-8959-d2199fdb84d0 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:48.459710 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-d7749330-afa1-443c-8959-d2199fdb84d0 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e46f6bf93bf4e839a0dfebd5409f32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c28a2aaa4b4d4bada90cea2b8ccff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:22:48.470693 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-d7749330-afa1-443c-8959-d2199fdb84d0 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] 10.222.0.20 "GET /compute/v2.1/servers/cb59f025-efd2-49c0-b90c-ce951e3d2d94" status: 200 len: 1314 microversion: 2.1 time: 0.180079 Jul 22 11:22:48.471104 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 513/1008] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:22:48 2022] GET /compute/v2.1/servers/cb59f025-efd2-49c0-b90c-ce951e3d2d94 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:22:48.527073 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.virt.hardware [None req-7cd4cd9e-0cf8-4900-9068-f9291b8a584d tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Flavor limits 0:0:0 {{(pid=117884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 22 11:22:48.527583 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.virt.hardware [None req-7cd4cd9e-0cf8-4900-9068-f9291b8a584d tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Image limits 0:0:0 {{(pid=117884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 22 11:22:48.528076 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.virt.hardware [None req-7cd4cd9e-0cf8-4900-9068-f9291b8a584d tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Flavor pref 0:0:0 {{(pid=117884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 22 11:22:48.528481 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.virt.hardware [None req-7cd4cd9e-0cf8-4900-9068-f9291b8a584d tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Image pref 0:0:0 {{(pid=117884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 22 11:22:48.528888 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.virt.hardware [None req-7cd4cd9e-0cf8-4900-9068-f9291b8a584d tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 22 11:22:48.539049 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-7cd4cd9e-0cf8-4900-9068-f9291b8a584d tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:48.539532 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-7cd4cd9e-0cf8-4900-9068-f9291b8a584d tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:48.540622 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-7cd4cd9e-0cf8-4900-9068-f9291b8a584d tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:48.540848 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-7cd4cd9e-0cf8-4900-9068-f9291b8a584d tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:48.557628 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.quota [None req-7cd4cd9e-0cf8-4900-9068-f9291b8a584d tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Getting quotas for project f756b95ab7da4271a50fa3b1a5276eea. Resources: {'instances', 'cores', 'ram'} {{(pid=117884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 22 11:22:48.561745 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.quota [None req-7cd4cd9e-0cf8-4900-9068-f9291b8a584d tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Getting quotas for user 00ab892a9233421886b849b879bd8a7e and project f756b95ab7da4271a50fa3b1a5276eea. Resources: {'instances', 'cores', 'ram'} {{(pid=117884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 22 11:22:48.572735 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-7cd4cd9e-0cf8-4900-9068-f9291b8a584d tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Going to run 1 instances... {{(pid=117884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 22 11:22:48.575089 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-7cd4cd9e-0cf8-4900-9068-f9291b8a584d tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] [instance: 73334795-ca3f-4da7-a3cd-af1ace25e74c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1a6c3cb4-9f56-44c6-aa68-01000df27209',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 22 11:22:48.621216 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-7cd4cd9e-0cf8-4900-9068-f9291b8a584d tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.566988 Jul 22 11:22:48.621869 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 496/1009] 10.222.0.20 () {60 vars in 1146 bytes} [Fri Jul 22 11:22:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 569 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 22 11:22:48.632614 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-94235fb6-5fb3-4a0f-9104-1e621d0377b5 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:22:48.632995 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-94235fb6-5fb3-4a0f-9104-1e621d0377b5 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] [instance: 73334795-ca3f-4da7-a3cd-af1ace25e74c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:22:48.645610 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-05760c9e-7ffd-42c4-92cb-f724da42db7c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:22:48.646391 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-05760c9e-7ffd-42c4-92cb-f724da42db7c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:22:48.657753 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-05760c9e-7ffd-42c4-92cb-f724da42db7c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:48.658198 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-05760c9e-7ffd-42c4-92cb-f724da42db7c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:48.659011 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-05760c9e-7ffd-42c4-92cb-f724da42db7c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:48.659513 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-05760c9e-7ffd-42c4-92cb-f724da42db7c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:48.678580 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.wsgi [None req-05760c9e-7ffd-42c4-92cb-f724da42db7c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] HTTP exception thrown: Instance f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 could not be found. Jul 22 11:22:48.680301 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-05760c9e-7ffd-42c4-92cb-f724da42db7c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Request method failure captured: Jul 22 11:22:48.680301 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: request: DELETE /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 HTTP/1.1 Jul 22 11:22:48.680301 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Accept: application/json Jul 22 11:22:48.680301 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Accept-Encoding: identity Jul 22 11:22:48.680301 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Connection: close Jul 22 11:22:48.680301 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Content-Length: 0 Jul 22 11:22:48.680301 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Content-Type: application/json Jul 22 11:22:48.680301 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Host: 10.222.0.20 Jul 22 11:22:48.680301 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Openstack-System-Scope: None Jul 22 11:22:48.680301 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: User-Agent: python-urllib3/1.26.9 Jul 22 11:22:48.680301 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Auth-Token: gAAAAABi2obkhLpwbPo8iCLViqoRP4IeqdCwt1UHm93yMDr_ne3LjF1_ecp2T8W8QtG5lp9yZAFjJojTvSrVywgsc-2Op4HesUZh2kcKDqDesLMRM36Pis_iVc7Es_mx9guoLwx8h0hAfY2dCZtZsS0tza2GEjm1Ji4suovm5RuuKLKZcM8dy5k Jul 22 11:22:48.680301 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Domain-Id: None Jul 22 11:22:48.680301 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Domain-Name: None Jul 22 11:22:48.680301 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Identity-Status: Confirmed Jul 22 11:22:48.680301 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Is-Admin-Project: True Jul 22 11:22:48.680301 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Openstack-Nova-Api-Version: 2.20 Jul 22 11:22:48.680301 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Domain-Id: default Jul 22 11:22:48.680301 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Domain-Name: Default Jul 22 11:22:48.680301 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Id: b745569c01e04aa18f5494b0856bc3d1 Jul 22 11:22:48.680301 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-101294574 Jul 22 11:22:48.680301 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Role: reader,member Jul 22 11:22:48.680301 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Roles: reader,member Jul 22 11:22:48.682198 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b745569c01e04aa18f5494b0856bc3d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b745569c01e04aa18f5494b0856bc3d1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b745569c01e04aa18f5494b0856bc3d1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b745569c01e04aa18f5494b0856bc3d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jul 22 11:22:48.682198 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant: tempest-AttachVolumeShelveTestJSON-101294574 Jul 22 11:22:48.682198 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant-Id: b745569c01e04aa18f5494b0856bc3d1 Jul 22 11:22:48.682198 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-101294574 Jul 22 11:22:48.682198 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User: tempest-AttachVolumeShelveTestJSON-101294574-project Jul 22 11:22:48.682198 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Domain-Id: default Jul 22 11:22:48.682198 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Domain-Name: Default Jul 22 11:22:48.682198 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Id: 99798aca08904bc787f5d0afee8d0ac7 Jul 22 11:22:48.682198 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Name: tempest-AttachVolumeShelveTestJSON-101294574-project Jul 22 11:22:48.682198 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: method: > Jul 22 11:22:48.682198 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: exception: Instance f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 could not be found. Jul 22 11:22:48.682198 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: action_args: {'id': 'f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46'} Jul 22 11:22:48.683151 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 22 11:22:48.683151 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:22:48.683151 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 22 11:22:48.683151 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 22 11:22:48.683151 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 22 11:22:48.683151 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 22 11:22:48.683151 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 22 11:22:48.683151 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 22 11:22:48.683151 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 22 11:22:48.683151 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 22 11:22:48.683151 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 could not be found. Jul 22 11:22:48.683151 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:22:48.683151 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:22:48.683151 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:22:48.683151 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:22:48.683151 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:22:48.683151 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:22:48.683151 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 22 11:22:48.683151 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 22 11:22:48.683151 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 22 11:22:48.685316 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 22 11:22:48.685316 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 22 11:22:48.685316 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 22 11:22:48.685316 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 22 11:22:48.685316 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 22 11:22:48.685316 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 22 11:22:48.685316 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 22 11:22:48.685316 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 22 11:22:48.685316 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 22 11:22:48.685316 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 could not be found. Jul 22 11:22:48.685316 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:22:48.685316 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:22:48.685316 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:22:48.685316 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:22:48.685316 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:22:48.685316 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:22:48.685316 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 22 11:22:48.685316 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 22 11:22:48.685316 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 could not be found. Jul 22 11:22:48.685316 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:22:48.687226 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-05760c9e-7ffd-42c4-92cb-f724da42db7c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Returning 404 to user: Instance f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 could not be found. {{(pid=117884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 22 11:22:48.687226 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-05760c9e-7ffd-42c4-92cb-f724da42db7c tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46" status: 404 len: 111 microversion: 2.20 time: 0.040127 Jul 22 11:22:48.687226 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 497/1010] 10.222.0.20 () {60 vars in 1279 bytes} [Fri Jul 22 11:22:48 2022] DELETE /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 22 11:22:48.691895 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-b73f7f2b-dc02-4015-8b19-8a66bc6cf54f tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:22:48.692537 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-b73f7f2b-dc02-4015-8b19-8a66bc6cf54f tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:22:48.698726 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-94235fb6-5fb3-4a0f-9104-1e621d0377b5 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00ab892a9233421886b849b879bd8a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f756b95ab7da4271a50fa3b1a5276eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:22:48.699094 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-b73f7f2b-dc02-4015-8b19-8a66bc6cf54f tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:48.699579 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-b73f7f2b-dc02-4015-8b19-8a66bc6cf54f tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:48.700353 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-b73f7f2b-dc02-4015-8b19-8a66bc6cf54f tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:48.700780 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-b73f7f2b-dc02-4015-8b19-8a66bc6cf54f tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:48.707750 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-94235fb6-5fb3-4a0f-9104-1e621d0377b5 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] 10.222.0.20 "GET /compute/v2.1/servers/73334795-ca3f-4da7-a3cd-af1ace25e74c" status: 200 len: 1219 microversion: 2.1 time: 0.079412 Jul 22 11:22:48.708439 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 514/1011] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:22:48 2022] GET /compute/v2.1/servers/73334795-ca3f-4da7-a3cd-af1ace25e74c => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:22:48.722448 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.wsgi [None req-b73f7f2b-dc02-4015-8b19-8a66bc6cf54f tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] HTTP exception thrown: Instance f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 could not be found. Jul 22 11:22:48.724868 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-b73f7f2b-dc02-4015-8b19-8a66bc6cf54f tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Request method failure captured: Jul 22 11:22:48.724868 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: request: GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 HTTP/1.1 Jul 22 11:22:48.724868 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Accept: application/json Jul 22 11:22:48.724868 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Accept-Encoding: identity Jul 22 11:22:48.724868 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Connection: close Jul 22 11:22:48.724868 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Content-Length: 0 Jul 22 11:22:48.724868 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Content-Type: application/json Jul 22 11:22:48.724868 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Host: 10.222.0.20 Jul 22 11:22:48.724868 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Openstack-System-Scope: None Jul 22 11:22:48.724868 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: User-Agent: python-urllib3/1.26.9 Jul 22 11:22:48.724868 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Auth-Token: gAAAAABi2obkhLpwbPo8iCLViqoRP4IeqdCwt1UHm93yMDr_ne3LjF1_ecp2T8W8QtG5lp9yZAFjJojTvSrVywgsc-2Op4HesUZh2kcKDqDesLMRM36Pis_iVc7Es_mx9guoLwx8h0hAfY2dCZtZsS0tza2GEjm1Ji4suovm5RuuKLKZcM8dy5k Jul 22 11:22:48.724868 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Domain-Id: None Jul 22 11:22:48.724868 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Domain-Name: None Jul 22 11:22:48.724868 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Identity-Status: Confirmed Jul 22 11:22:48.724868 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Is-Admin-Project: True Jul 22 11:22:48.724868 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Openstack-Nova-Api-Version: 2.20 Jul 22 11:22:48.724868 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Domain-Id: default Jul 22 11:22:48.724868 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Domain-Name: Default Jul 22 11:22:48.724868 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Id: b745569c01e04aa18f5494b0856bc3d1 Jul 22 11:22:48.724868 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-101294574 Jul 22 11:22:48.724868 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Role: reader,member Jul 22 11:22:48.724868 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Roles: reader,member Jul 22 11:22:48.727846 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b745569c01e04aa18f5494b0856bc3d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b745569c01e04aa18f5494b0856bc3d1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b745569c01e04aa18f5494b0856bc3d1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b745569c01e04aa18f5494b0856bc3d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jul 22 11:22:48.727846 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant: tempest-AttachVolumeShelveTestJSON-101294574 Jul 22 11:22:48.727846 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant-Id: b745569c01e04aa18f5494b0856bc3d1 Jul 22 11:22:48.727846 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-101294574 Jul 22 11:22:48.727846 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User: tempest-AttachVolumeShelveTestJSON-101294574-project Jul 22 11:22:48.727846 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Domain-Id: default Jul 22 11:22:48.727846 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Domain-Name: Default Jul 22 11:22:48.727846 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Id: 99798aca08904bc787f5d0afee8d0ac7 Jul 22 11:22:48.727846 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Name: tempest-AttachVolumeShelveTestJSON-101294574-project Jul 22 11:22:48.727846 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: method: > Jul 22 11:22:48.727846 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: exception: Instance f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 could not be found. Jul 22 11:22:48.727846 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: action_args: {'id': 'f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46'} Jul 22 11:22:48.729494 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 22 11:22:48.729494 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:22:48.729494 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 22 11:22:48.729494 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 22 11:22:48.729494 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 22 11:22:48.729494 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 22 11:22:48.729494 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 22 11:22:48.729494 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 22 11:22:48.729494 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 22 11:22:48.729494 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 22 11:22:48.729494 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 could not be found. Jul 22 11:22:48.729494 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:22:48.729494 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:22:48.729494 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:22:48.729494 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:22:48.729494 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:22:48.729494 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:22:48.729494 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 22 11:22:48.729494 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 22 11:22:48.729494 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 22 11:22:48.732237 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 22 11:22:48.732237 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 22 11:22:48.732237 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 22 11:22:48.732237 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 22 11:22:48.732237 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 22 11:22:48.732237 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 22 11:22:48.732237 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 22 11:22:48.732237 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 could not be found. Jul 22 11:22:48.732237 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:22:48.732237 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:22:48.732237 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:22:48.732237 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:22:48.732237 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:22:48.732237 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:22:48.732237 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 22 11:22:48.732237 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 22 11:22:48.732237 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 could not be found. Jul 22 11:22:48.732237 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:22:48.736081 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-b73f7f2b-dc02-4015-8b19-8a66bc6cf54f tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Returning 404 to user: Instance f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 could not be found. {{(pid=117884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 22 11:22:48.736081 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-b73f7f2b-dc02-4015-8b19-8a66bc6cf54f tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46" status: 404 len: 111 microversion: 2.20 time: 0.039147 Jul 22 11:22:48.736081 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 498/1012] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:22:48 2022] GET /compute/v2.1/servers/f0cfbbe3-bc06-476d-a92a-bbd38a3e0f46 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 22 11:22:49.491012 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-b0f395d6-32f8-4366-9222-4c200b9b964f tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:22:49.491600 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-b0f395d6-32f8-4366-9222-4c200b9b964f tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] [instance: cb59f025-efd2-49c0-b90c-ce951e3d2d94] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:22:49.493913 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:22:49.500103 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b0f395d6-32f8-4366-9222-4c200b9b964f tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:49.500562 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b0f395d6-32f8-4366-9222-4c200b9b964f tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:49.501350 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b0f395d6-32f8-4366-9222-4c200b9b964f tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:49.501789 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b0f395d6-32f8-4366-9222-4c200b9b964f tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:49.651583 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-b0f395d6-32f8-4366-9222-4c200b9b964f tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e46f6bf93bf4e839a0dfebd5409f32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c28a2aaa4b4d4bada90cea2b8ccff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:22:49.660160 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-b0f395d6-32f8-4366-9222-4c200b9b964f tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] 10.222.0.20 "GET /compute/v2.1/servers/cb59f025-efd2-49c0-b90c-ce951e3d2d94" status: 200 len: 1498 microversion: 2.1 time: 0.173295 Jul 22 11:22:49.660750 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 515/1013] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:22:49 2022] GET /compute/v2.1/servers/cb59f025-efd2-49c0-b90c-ce951e3d2d94 => generated 1498 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:22:49.725542 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-225ac000-7071-4060-99f3-bbf866d4c8f3 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:22:49.726786 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-225ac000-7071-4060-99f3-bbf866d4c8f3 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] [instance: 73334795-ca3f-4da7-a3cd-af1ace25e74c] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:22:49.736332 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-225ac000-7071-4060-99f3-bbf866d4c8f3 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:49.737131 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-225ac000-7071-4060-99f3-bbf866d4c8f3 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:49.737999 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-225ac000-7071-4060-99f3-bbf866d4c8f3 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:49.738484 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-225ac000-7071-4060-99f3-bbf866d4c8f3 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:49.845784 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-225ac000-7071-4060-99f3-bbf866d4c8f3 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00ab892a9233421886b849b879bd8a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f756b95ab7da4271a50fa3b1a5276eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:22:49.858164 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-225ac000-7071-4060-99f3-bbf866d4c8f3 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] 10.222.0.20 "GET /compute/v2.1/servers/73334795-ca3f-4da7-a3cd-af1ace25e74c" status: 200 len: 1289 microversion: 2.1 time: 0.136575 Jul 22 11:22:49.861073 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 499/1014] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:22:49 2022] GET /compute/v2.1/servers/73334795-ca3f-4da7-a3cd-af1ace25e74c => generated 1289 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:22:49.917669 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-f82be41c-835d-4164-855d-761fd1dfd92d tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:22:49.918176 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-f82be41c-835d-4164-855d-761fd1dfd92d tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:22:49.924654 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f82be41c-835d-4164-855d-761fd1dfd92d tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:49.925685 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f82be41c-835d-4164-855d-761fd1dfd92d tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:49.925872 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f82be41c-835d-4164-855d-761fd1dfd92d tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:49.926666 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f82be41c-835d-4164-855d-761fd1dfd92d tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:49.945789 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.wsgi [None req-f82be41c-835d-4164-855d-761fd1dfd92d tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] HTTP exception thrown: Instance 1f27dab8-c005-4dd0-b262-542deb60dd54 could not be found. Jul 22 11:22:49.948056 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-f82be41c-835d-4164-855d-761fd1dfd92d tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Request method failure captured: Jul 22 11:22:49.948056 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: request: DELETE /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 HTTP/1.1 Jul 22 11:22:49.948056 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Accept: application/json Jul 22 11:22:49.948056 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Accept-Encoding: identity Jul 22 11:22:49.948056 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Connection: close Jul 22 11:22:49.948056 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Content-Length: 0 Jul 22 11:22:49.948056 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Content-Type: application/json Jul 22 11:22:49.948056 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Host: 10.222.0.20 Jul 22 11:22:49.948056 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Openstack-System-Scope: None Jul 22 11:22:49.948056 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: User-Agent: python-urllib3/1.26.9 Jul 22 11:22:49.948056 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Auth-Token: gAAAAABi2obkhLpwbPo8iCLViqoRP4IeqdCwt1UHm93yMDr_ne3LjF1_ecp2T8W8QtG5lp9yZAFjJojTvSrVywgsc-2Op4HesUZh2kcKDqDesLMRM36Pis_iVc7Es_mx9guoLwx8h0hAfY2dCZtZsS0tza2GEjm1Ji4suovm5RuuKLKZcM8dy5k Jul 22 11:22:49.948056 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Domain-Id: None Jul 22 11:22:49.948056 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Domain-Name: None Jul 22 11:22:49.948056 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Identity-Status: Confirmed Jul 22 11:22:49.948056 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Is-Admin-Project: True Jul 22 11:22:49.948056 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Openstack-Nova-Api-Version: 2.20 Jul 22 11:22:49.948056 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Project-Domain-Id: default Jul 22 11:22:49.948056 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Project-Domain-Name: Default Jul 22 11:22:49.948056 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Project-Id: b745569c01e04aa18f5494b0856bc3d1 Jul 22 11:22:49.948056 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-101294574 Jul 22 11:22:49.948056 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Role: reader,member Jul 22 11:22:49.948056 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Roles: reader,member Jul 22 11:22:49.950733 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b745569c01e04aa18f5494b0856bc3d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b745569c01e04aa18f5494b0856bc3d1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b745569c01e04aa18f5494b0856bc3d1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b745569c01e04aa18f5494b0856bc3d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jul 22 11:22:49.950733 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Tenant: tempest-AttachVolumeShelveTestJSON-101294574 Jul 22 11:22:49.950733 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Tenant-Id: b745569c01e04aa18f5494b0856bc3d1 Jul 22 11:22:49.950733 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-101294574 Jul 22 11:22:49.950733 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User: tempest-AttachVolumeShelveTestJSON-101294574-project Jul 22 11:22:49.950733 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User-Domain-Id: default Jul 22 11:22:49.950733 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User-Domain-Name: Default Jul 22 11:22:49.950733 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User-Id: 99798aca08904bc787f5d0afee8d0ac7 Jul 22 11:22:49.950733 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User-Name: tempest-AttachVolumeShelveTestJSON-101294574-project Jul 22 11:22:49.950733 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: method: > Jul 22 11:22:49.950733 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: exception: Instance 1f27dab8-c005-4dd0-b262-542deb60dd54 could not be found. Jul 22 11:22:49.950733 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: action_args: {'id': '1f27dab8-c005-4dd0-b262-542deb60dd54'} Jul 22 11:22:49.952804 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 22 11:22:49.952804 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:22:49.952804 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 22 11:22:49.952804 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 22 11:22:49.952804 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 22 11:22:49.952804 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 22 11:22:49.952804 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 22 11:22:49.952804 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 22 11:22:49.952804 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 22 11:22:49.952804 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 22 11:22:49.952804 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f27dab8-c005-4dd0-b262-542deb60dd54 could not be found. Jul 22 11:22:49.952804 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:22:49.952804 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:22:49.952804 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:22:49.952804 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:22:49.952804 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:22:49.952804 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:22:49.952804 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 22 11:22:49.952804 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 22 11:22:49.952804 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 22 11:22:49.955466 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 22 11:22:49.955466 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 22 11:22:49.955466 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 22 11:22:49.955466 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 22 11:22:49.955466 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 22 11:22:49.955466 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 22 11:22:49.955466 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 22 11:22:49.955466 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 22 11:22:49.955466 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 22 11:22:49.955466 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f27dab8-c005-4dd0-b262-542deb60dd54 could not be found. Jul 22 11:22:49.955466 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:22:49.955466 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:22:49.955466 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:22:49.955466 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:22:49.955466 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:22:49.955466 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:22:49.955466 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 22 11:22:49.955466 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 22 11:22:49.955466 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f27dab8-c005-4dd0-b262-542deb60dd54 could not be found. Jul 22 11:22:49.955466 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:22:49.961283 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-f82be41c-835d-4164-855d-761fd1dfd92d tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Returning 404 to user: Instance 1f27dab8-c005-4dd0-b262-542deb60dd54 could not be found. {{(pid=117885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 22 11:22:49.961283 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-f82be41c-835d-4164-855d-761fd1dfd92d tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54" status: 404 len: 111 microversion: 2.20 time: 0.047072 Jul 22 11:22:49.961283 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 516/1015] 10.222.0.20 () {60 vars in 1279 bytes} [Fri Jul 22 11:22:49 2022] DELETE /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 22 11:22:49.972349 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-ae55e1d9-3dca-4cbc-b176-48d844fc85c3 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:22:49.973324 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-ae55e1d9-3dca-4cbc-b176-48d844fc85c3 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] [instance: 1f27dab8-c005-4dd0-b262-542deb60dd54] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:22:49.981014 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-ae55e1d9-3dca-4cbc-b176-48d844fc85c3 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:49.981745 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-ae55e1d9-3dca-4cbc-b176-48d844fc85c3 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:49.982618 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-ae55e1d9-3dca-4cbc-b176-48d844fc85c3 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:49.983291 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-ae55e1d9-3dca-4cbc-b176-48d844fc85c3 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:50.003978 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.wsgi [None req-ae55e1d9-3dca-4cbc-b176-48d844fc85c3 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] HTTP exception thrown: Instance 1f27dab8-c005-4dd0-b262-542deb60dd54 could not be found. Jul 22 11:22:50.005644 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-ae55e1d9-3dca-4cbc-b176-48d844fc85c3 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Request method failure captured: Jul 22 11:22:50.005644 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: request: GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 HTTP/1.1 Jul 22 11:22:50.005644 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Accept: application/json Jul 22 11:22:50.005644 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Accept-Encoding: identity Jul 22 11:22:50.005644 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Connection: close Jul 22 11:22:50.005644 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Content-Length: 0 Jul 22 11:22:50.005644 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Content-Type: application/json Jul 22 11:22:50.005644 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Host: 10.222.0.20 Jul 22 11:22:50.005644 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Openstack-System-Scope: None Jul 22 11:22:50.005644 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: User-Agent: python-urllib3/1.26.9 Jul 22 11:22:50.005644 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Auth-Token: gAAAAABi2obkhLpwbPo8iCLViqoRP4IeqdCwt1UHm93yMDr_ne3LjF1_ecp2T8W8QtG5lp9yZAFjJojTvSrVywgsc-2Op4HesUZh2kcKDqDesLMRM36Pis_iVc7Es_mx9guoLwx8h0hAfY2dCZtZsS0tza2GEjm1Ji4suovm5RuuKLKZcM8dy5k Jul 22 11:22:50.005644 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Domain-Id: None Jul 22 11:22:50.005644 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Domain-Name: None Jul 22 11:22:50.005644 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Identity-Status: Confirmed Jul 22 11:22:50.005644 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Is-Admin-Project: True Jul 22 11:22:50.005644 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Openstack-Nova-Api-Version: 2.20 Jul 22 11:22:50.005644 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Domain-Id: default Jul 22 11:22:50.005644 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Domain-Name: Default Jul 22 11:22:50.005644 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Id: b745569c01e04aa18f5494b0856bc3d1 Jul 22 11:22:50.005644 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-101294574 Jul 22 11:22:50.005644 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Role: reader,member Jul 22 11:22:50.005644 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Roles: reader,member Jul 22 11:22:50.007383 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b745569c01e04aa18f5494b0856bc3d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b745569c01e04aa18f5494b0856bc3d1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b745569c01e04aa18f5494b0856bc3d1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b745569c01e04aa18f5494b0856bc3d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jul 22 11:22:50.007383 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant: tempest-AttachVolumeShelveTestJSON-101294574 Jul 22 11:22:50.007383 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant-Id: b745569c01e04aa18f5494b0856bc3d1 Jul 22 11:22:50.007383 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-101294574 Jul 22 11:22:50.007383 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User: tempest-AttachVolumeShelveTestJSON-101294574-project Jul 22 11:22:50.007383 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Domain-Id: default Jul 22 11:22:50.007383 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Domain-Name: Default Jul 22 11:22:50.007383 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Id: 99798aca08904bc787f5d0afee8d0ac7 Jul 22 11:22:50.007383 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Name: tempest-AttachVolumeShelveTestJSON-101294574-project Jul 22 11:22:50.007383 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: method: > Jul 22 11:22:50.007383 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: exception: Instance 1f27dab8-c005-4dd0-b262-542deb60dd54 could not be found. Jul 22 11:22:50.007383 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: action_args: {'id': '1f27dab8-c005-4dd0-b262-542deb60dd54'} Jul 22 11:22:50.008699 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 22 11:22:50.008699 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:22:50.008699 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 22 11:22:50.008699 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 22 11:22:50.008699 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 22 11:22:50.008699 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 22 11:22:50.008699 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 22 11:22:50.008699 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 22 11:22:50.008699 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 22 11:22:50.008699 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 22 11:22:50.008699 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f27dab8-c005-4dd0-b262-542deb60dd54 could not be found. Jul 22 11:22:50.008699 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:22:50.008699 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:22:50.008699 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:22:50.008699 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:22:50.008699 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:22:50.008699 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:22:50.008699 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 22 11:22:50.008699 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 22 11:22:50.008699 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 22 11:22:50.010195 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 22 11:22:50.010195 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 22 11:22:50.010195 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 22 11:22:50.010195 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 22 11:22:50.010195 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 22 11:22:50.010195 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 22 11:22:50.010195 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 22 11:22:50.010195 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f27dab8-c005-4dd0-b262-542deb60dd54 could not be found. Jul 22 11:22:50.010195 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:22:50.010195 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:22:50.010195 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:22:50.010195 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:22:50.010195 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:22:50.010195 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:22:50.010195 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 22 11:22:50.010195 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 22 11:22:50.010195 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f27dab8-c005-4dd0-b262-542deb60dd54 could not be found. Jul 22 11:22:50.010195 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:22:50.011698 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-ae55e1d9-3dca-4cbc-b176-48d844fc85c3 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] Returning 404 to user: Instance 1f27dab8-c005-4dd0-b262-542deb60dd54 could not be found. {{(pid=117884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 22 11:22:50.011698 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-ae55e1d9-3dca-4cbc-b176-48d844fc85c3 tempest-AttachVolumeShelveTestJSON-101294574 tempest-AttachVolumeShelveTestJSON-101294574-project] 10.222.0.20 "GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54" status: 404 len: 111 microversion: 2.20 time: 0.040875 Jul 22 11:22:50.011698 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 500/1016] 10.222.0.20 () {60 vars in 1276 bytes} [Fri Jul 22 11:22:49 2022] GET /compute/v2.1/servers/1f27dab8-c005-4dd0-b262-542deb60dd54 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 22 11:22:50.251736 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-7b60953f-80a0-45bf-8b02-46115270f55a tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:22:50.252245 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-7b60953f-80a0-45bf-8b02-46115270f55a tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] [instance: cb59f025-efd2-49c0-b90c-ce951e3d2d94] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:22:50.258623 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7b60953f-80a0-45bf-8b02-46115270f55a tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:50.259395 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7b60953f-80a0-45bf-8b02-46115270f55a tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:50.260165 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7b60953f-80a0-45bf-8b02-46115270f55a tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:50.260590 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7b60953f-80a0-45bf-8b02-46115270f55a tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:50.265437 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:22:50.290032 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-7b60953f-80a0-45bf-8b02-46115270f55a tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] [instance: cb59f025-efd2-49c0-b90c-ce951e3d2d94] Going to try to terminate instance {{(pid=117885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 22 11:22:50.391392 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-7b60953f-80a0-45bf-8b02-46115270f55a tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] 10.222.0.20 "DELETE /compute/v2.1/servers/cb59f025-efd2-49c0-b90c-ce951e3d2d94" status: 204 len: 0 microversion: 2.1 time: 0.143508 Jul 22 11:22:50.392141 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 517/1017] 10.222.0.20 () {58 vars in 1238 bytes} [Fri Jul 22 11:22:50 2022] DELETE /compute/v2.1/servers/cb59f025-efd2-49c0-b90c-ce951e3d2d94 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 22 11:22:50.405523 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-d180f4ef-c245-4c64-a05c-efe78c139844 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:22:50.407443 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-d180f4ef-c245-4c64-a05c-efe78c139844 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] [instance: cb59f025-efd2-49c0-b90c-ce951e3d2d94] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:22:50.415361 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-d180f4ef-c245-4c64-a05c-efe78c139844 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:50.416152 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-d180f4ef-c245-4c64-a05c-efe78c139844 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:50.417238 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-d180f4ef-c245-4c64-a05c-efe78c139844 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:50.418197 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-d180f4ef-c245-4c64-a05c-efe78c139844 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:50.699977 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-d180f4ef-c245-4c64-a05c-efe78c139844 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e46f6bf93bf4e839a0dfebd5409f32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c28a2aaa4b4d4bada90cea2b8ccff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:22:50.709845 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-d180f4ef-c245-4c64-a05c-efe78c139844 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] 10.222.0.20 "GET /compute/v2.1/servers/cb59f025-efd2-49c0-b90c-ce951e3d2d94" status: 200 len: 1504 microversion: 2.1 time: 0.311837 Jul 22 11:22:50.710440 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 501/1018] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:22:50 2022] GET /compute/v2.1/servers/cb59f025-efd2-49c0-b90c-ce951e3d2d94 => generated 1504 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:22:50.876548 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-0c91c53d-7417-4f22-a626-381aa2b8bc26 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:22:50.877278 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-0c91c53d-7417-4f22-a626-381aa2b8bc26 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] [instance: 73334795-ca3f-4da7-a3cd-af1ace25e74c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:22:50.884105 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0c91c53d-7417-4f22-a626-381aa2b8bc26 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:50.884541 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0c91c53d-7417-4f22-a626-381aa2b8bc26 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:50.886975 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0c91c53d-7417-4f22-a626-381aa2b8bc26 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:50.886975 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0c91c53d-7417-4f22-a626-381aa2b8bc26 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:51.103883 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-0c91c53d-7417-4f22-a626-381aa2b8bc26 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00ab892a9233421886b849b879bd8a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f756b95ab7da4271a50fa3b1a5276eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:22:51.112123 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-0c91c53d-7417-4f22-a626-381aa2b8bc26 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] 10.222.0.20 "GET /compute/v2.1/servers/73334795-ca3f-4da7-a3cd-af1ace25e74c" status: 200 len: 1319 microversion: 2.1 time: 0.240465 Jul 22 11:22:51.112722 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 518/1019] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:22:50 2022] GET /compute/v2.1/servers/73334795-ca3f-4da7-a3cd-af1ace25e74c => generated 1319 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:22:51.727461 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-78d72f8b-5e00-44bf-a5b7-0640530f55ef tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:22:51.728362 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-78d72f8b-5e00-44bf-a5b7-0640530f55ef tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] [instance: cb59f025-efd2-49c0-b90c-ce951e3d2d94] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:22:51.747029 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-78d72f8b-5e00-44bf-a5b7-0640530f55ef tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:51.747870 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-78d72f8b-5e00-44bf-a5b7-0640530f55ef tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:51.749776 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-78d72f8b-5e00-44bf-a5b7-0640530f55ef tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:51.756488 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-78d72f8b-5e00-44bf-a5b7-0640530f55ef tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:52.093405 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-78d72f8b-5e00-44bf-a5b7-0640530f55ef tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e46f6bf93bf4e839a0dfebd5409f32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c28a2aaa4b4d4bada90cea2b8ccff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:22:52.109368 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-78d72f8b-5e00-44bf-a5b7-0640530f55ef tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] 10.222.0.20 "GET /compute/v2.1/servers/cb59f025-efd2-49c0-b90c-ce951e3d2d94" status: 200 len: 1504 microversion: 2.1 time: 0.381035 Jul 22 11:22:52.122633 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 502/1020] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:22:51 2022] GET /compute/v2.1/servers/cb59f025-efd2-49c0-b90c-ce951e3d2d94 => generated 1504 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:22:52.132815 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-f4489ecf-034e-4331-a156-933e50d60354 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:22:52.134802 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-f4489ecf-034e-4331-a156-933e50d60354 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] [instance: 73334795-ca3f-4da7-a3cd-af1ace25e74c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:22:52.145475 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f4489ecf-034e-4331-a156-933e50d60354 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:52.146172 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f4489ecf-034e-4331-a156-933e50d60354 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:52.147189 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f4489ecf-034e-4331-a156-933e50d60354 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:52.148423 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f4489ecf-034e-4331-a156-933e50d60354 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:52.398600 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-f4489ecf-034e-4331-a156-933e50d60354 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00ab892a9233421886b849b879bd8a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f756b95ab7da4271a50fa3b1a5276eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:22:52.413221 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-f4489ecf-034e-4331-a156-933e50d60354 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] 10.222.0.20 "GET /compute/v2.1/servers/73334795-ca3f-4da7-a3cd-af1ace25e74c" status: 200 len: 1319 microversion: 2.1 time: 0.285156 Jul 22 11:22:52.414907 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 519/1021] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:22:52 2022] GET /compute/v2.1/servers/73334795-ca3f-4da7-a3cd-af1ace25e74c => generated 1319 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:22:53.138357 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-0a1752a6-3899-4998-9b4e-26f651fe2358 req-13964096-8bf0-434b-85f5-c519c767fad1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb59f025-efd2-49c0-b90c-ce951e3d2d94", "name": "network-vif-deleted", "tag": "238bb944-cf08-41f6-ae54-94b8537277a0"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:22:53.139717 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-3a7956f7-0ffc-4c8f-80e9-91e888f08ea7 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:22:53.142578 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-3a7956f7-0ffc-4c8f-80e9-91e888f08ea7 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] [instance: cb59f025-efd2-49c0-b90c-ce951e3d2d94] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:22:53.183697 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-3a7956f7-0ffc-4c8f-80e9-91e888f08ea7 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:53.184159 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-3a7956f7-0ffc-4c8f-80e9-91e888f08ea7 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:53.184919 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-3a7956f7-0ffc-4c8f-80e9-91e888f08ea7 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:53.185348 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-3a7956f7-0ffc-4c8f-80e9-91e888f08ea7 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:53.201007 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-0a1752a6-3899-4998-9b4e-26f651fe2358 req-13964096-8bf0-434b-85f5-c519c767fad1 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:53.202794 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-0a1752a6-3899-4998-9b4e-26f651fe2358 req-13964096-8bf0-434b-85f5-c519c767fad1 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:53.255622 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-0a1752a6-3899-4998-9b4e-26f651fe2358 req-13964096-8bf0-434b-85f5-c519c767fad1 service nova] Creating event network-vif-deleted:238bb944-cf08-41f6-ae54-94b8537277a0 for instance cb59f025-efd2-49c0-b90c-ce951e3d2d94 on hv-cinder-84890 Jul 22 11:22:53.261890 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-0a1752a6-3899-4998-9b4e-26f651fe2358 req-13964096-8bf0-434b-85f5-c519c767fad1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129399 Jul 22 11:22:53.263202 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 520/1022] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:22:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:22:53.286373 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-3a7956f7-0ffc-4c8f-80e9-91e888f08ea7 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e46f6bf93bf4e839a0dfebd5409f32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c28a2aaa4b4d4bada90cea2b8ccff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:22:53.300271 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-3a7956f7-0ffc-4c8f-80e9-91e888f08ea7 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] 10.222.0.20 "GET /compute/v2.1/servers/cb59f025-efd2-49c0-b90c-ce951e3d2d94" status: 200 len: 1299 microversion: 2.1 time: 0.173277 Jul 22 11:22:53.318078 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 503/1023] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:22:53 2022] GET /compute/v2.1/servers/cb59f025-efd2-49c0-b90c-ce951e3d2d94 => generated 1299 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:22:53.435196 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-1fcfb122-a8c0-4ff8-aac4-9cad587e8cf4 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:22:53.438865 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-1fcfb122-a8c0-4ff8-aac4-9cad587e8cf4 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] [instance: 73334795-ca3f-4da7-a3cd-af1ace25e74c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:22:53.453997 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1fcfb122-a8c0-4ff8-aac4-9cad587e8cf4 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:53.454476 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1fcfb122-a8c0-4ff8-aac4-9cad587e8cf4 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:53.455298 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1fcfb122-a8c0-4ff8-aac4-9cad587e8cf4 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:53.455760 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1fcfb122-a8c0-4ff8-aac4-9cad587e8cf4 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:53.687577 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-1fcfb122-a8c0-4ff8-aac4-9cad587e8cf4 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00ab892a9233421886b849b879bd8a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f756b95ab7da4271a50fa3b1a5276eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:22:53.701063 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-1fcfb122-a8c0-4ff8-aac4-9cad587e8cf4 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] 10.222.0.20 "GET /compute/v2.1/servers/73334795-ca3f-4da7-a3cd-af1ace25e74c" status: 200 len: 1319 microversion: 2.1 time: 0.273162 Jul 22 11:22:53.703365 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 521/1024] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:22:53 2022] GET /compute/v2.1/servers/73334795-ca3f-4da7-a3cd-af1ace25e74c => generated 1319 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:22:54.318903 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-9232eb4e-7075-4d06-a643-5f68f7c39bf7 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:22:54.319577 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-9232eb4e-7075-4d06-a643-5f68f7c39bf7 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] [instance: cb59f025-efd2-49c0-b90c-ce951e3d2d94] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:22:54.331425 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-9232eb4e-7075-4d06-a643-5f68f7c39bf7 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:54.332310 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-9232eb4e-7075-4d06-a643-5f68f7c39bf7 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:54.334340 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-9232eb4e-7075-4d06-a643-5f68f7c39bf7 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:54.335109 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-9232eb4e-7075-4d06-a643-5f68f7c39bf7 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:54.351430 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.wsgi [None req-9232eb4e-7075-4d06-a643-5f68f7c39bf7 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] HTTP exception thrown: Instance cb59f025-efd2-49c0-b90c-ce951e3d2d94 could not be found. Jul 22 11:22:54.353003 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-9232eb4e-7075-4d06-a643-5f68f7c39bf7 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Request method failure captured: Jul 22 11:22:54.353003 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: request: GET /compute/v2.1/servers/cb59f025-efd2-49c0-b90c-ce951e3d2d94 HTTP/1.1 Jul 22 11:22:54.353003 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Accept: application/json Jul 22 11:22:54.353003 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Accept-Encoding: identity Jul 22 11:22:54.353003 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Connection: close Jul 22 11:22:54.353003 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Content-Length: 0 Jul 22 11:22:54.353003 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Content-Type: application/json Jul 22 11:22:54.353003 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Host: 10.222.0.20 Jul 22 11:22:54.353003 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Openstack-System-Scope: None Jul 22 11:22:54.353003 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: User-Agent: python-urllib3/1.26.9 Jul 22 11:22:54.353003 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Auth-Token: gAAAAABi2ohoGuf9hQh7QDnRrPr-PWk3YJOQO8XX-0IQnm_IHKKIQzEkXhJR8SeJA9wVzSvTVARW8j4UNLdjit5ULI4ssTkUbzJo2qCXKtHcybVVRTQlISc_SUlhqmAQ7Fy0fWNmWAvteFVGcqxk1Ke8DMRp2beyHPjaW01AWFx4Rt3IhBE870s Jul 22 11:22:54.353003 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Domain-Id: None Jul 22 11:22:54.353003 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Domain-Name: None Jul 22 11:22:54.353003 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Identity-Status: Confirmed Jul 22 11:22:54.353003 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Is-Admin-Project: True Jul 22 11:22:54.353003 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Domain-Id: default Jul 22 11:22:54.353003 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Domain-Name: Default Jul 22 11:22:54.353003 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Id: 17c28a2aaa4b4d4bada90cea2b8ccff5 Jul 22 11:22:54.353003 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Name: tempest-VolumesActionsTest-573291871 Jul 22 11:22:54.353003 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Role: reader,member Jul 22 11:22:54.353003 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Roles: reader,member Jul 22 11:22:54.354504 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/17c28a2aaa4b4d4bada90cea2b8ccff5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_17c28a2aaa4b4d4bada90cea2b8ccff5", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/17c28a2aaa4b4d4bada90cea2b8ccff5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/17c28a2aaa4b4d4bada90cea2b8ccff5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jul 22 11:22:54.354504 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant: tempest-VolumesActionsTest-573291871 Jul 22 11:22:54.354504 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant-Id: 17c28a2aaa4b4d4bada90cea2b8ccff5 Jul 22 11:22:54.354504 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant-Name: tempest-VolumesActionsTest-573291871 Jul 22 11:22:54.354504 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User: tempest-VolumesActionsTest-573291871-project Jul 22 11:22:54.354504 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Domain-Id: default Jul 22 11:22:54.354504 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Domain-Name: Default Jul 22 11:22:54.354504 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Id: 2e46f6bf93bf4e839a0dfebd5409f32e Jul 22 11:22:54.354504 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Name: tempest-VolumesActionsTest-573291871-project Jul 22 11:22:54.354504 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: method: > Jul 22 11:22:54.354504 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: exception: Instance cb59f025-efd2-49c0-b90c-ce951e3d2d94 could not be found. Jul 22 11:22:54.354504 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: action_args: {'id': 'cb59f025-efd2-49c0-b90c-ce951e3d2d94'} Jul 22 11:22:54.355243 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 22 11:22:54.355243 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:22:54.355243 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 22 11:22:54.355243 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 22 11:22:54.355243 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 22 11:22:54.355243 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 22 11:22:54.355243 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 22 11:22:54.355243 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 22 11:22:54.355243 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 22 11:22:54.355243 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 22 11:22:54.355243 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb59f025-efd2-49c0-b90c-ce951e3d2d94 could not be found. Jul 22 11:22:54.355243 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:22:54.355243 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:22:54.355243 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:22:54.355243 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:22:54.355243 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:22:54.355243 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:22:54.355243 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 22 11:22:54.355243 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 22 11:22:54.355243 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 22 11:22:54.357477 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 22 11:22:54.357477 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 22 11:22:54.357477 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 22 11:22:54.357477 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 22 11:22:54.357477 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 22 11:22:54.357477 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 22 11:22:54.357477 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 22 11:22:54.357477 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb59f025-efd2-49c0-b90c-ce951e3d2d94 could not be found. Jul 22 11:22:54.357477 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:22:54.357477 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:22:54.357477 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:22:54.357477 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:22:54.357477 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:22:54.357477 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:22:54.357477 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 22 11:22:54.357477 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 22 11:22:54.357477 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb59f025-efd2-49c0-b90c-ce951e3d2d94 could not be found. Jul 22 11:22:54.357477 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:22:54.360714 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-9232eb4e-7075-4d06-a643-5f68f7c39bf7 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] Returning 404 to user: Instance cb59f025-efd2-49c0-b90c-ce951e3d2d94 could not be found. {{(pid=117884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 22 11:22:54.360714 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-9232eb4e-7075-4d06-a643-5f68f7c39bf7 tempest-VolumesActionsTest-573291871 tempest-VolumesActionsTest-573291871-project] 10.222.0.20 "GET /compute/v2.1/servers/cb59f025-efd2-49c0-b90c-ce951e3d2d94" status: 404 len: 111 microversion: 2.1 time: 0.040424 Jul 22 11:22:54.360714 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 504/1025] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:22:54 2022] GET /compute/v2.1/servers/cb59f025-efd2-49c0-b90c-ce951e3d2d94 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 22 11:22:54.721467 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-4fd93830-352c-4ca8-b253-c666aec04e1a tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:22:54.722617 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-4fd93830-352c-4ca8-b253-c666aec04e1a tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] [instance: 73334795-ca3f-4da7-a3cd-af1ace25e74c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:22:54.730363 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4fd93830-352c-4ca8-b253-c666aec04e1a tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:54.731154 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4fd93830-352c-4ca8-b253-c666aec04e1a tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:54.731981 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4fd93830-352c-4ca8-b253-c666aec04e1a tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:54.732417 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4fd93830-352c-4ca8-b253-c666aec04e1a tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:54.891383 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-4fd93830-352c-4ca8-b253-c666aec04e1a tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00ab892a9233421886b849b879bd8a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f756b95ab7da4271a50fa3b1a5276eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:22:54.899714 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-4fd93830-352c-4ca8-b253-c666aec04e1a tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] 10.222.0.20 "GET /compute/v2.1/servers/73334795-ca3f-4da7-a3cd-af1ace25e74c" status: 200 len: 1319 microversion: 2.1 time: 0.182812 Jul 22 11:22:54.900532 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 522/1026] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:22:54 2022] GET /compute/v2.1/servers/73334795-ca3f-4da7-a3cd-af1ace25e74c => generated 1319 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:22:55.290678 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [req-59f9844e-40f1-4420-a950-8c7787491efe req-a7d78c77-bc2a-4f6b-822d-36f4e2595622 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73334795-ca3f-4da7-a3cd-af1ace25e74c", "tag": "c8beaed8-70cd-4d5c-982a-92365698836f"}]} {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:22:55.300783 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-59f9844e-40f1-4420-a950-8c7787491efe req-a7d78c77-bc2a-4f6b-822d-36f4e2595622 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:55.301350 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-59f9844e-40f1-4420-a950-8c7787491efe req-a7d78c77-bc2a-4f6b-822d-36f4e2595622 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:55.315782 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.compute.server_external_events [req-59f9844e-40f1-4420-a950-8c7787491efe req-a7d78c77-bc2a-4f6b-822d-36f4e2595622 service nova] Creating event network-changed:c8beaed8-70cd-4d5c-982a-92365698836f for instance 73334795-ca3f-4da7-a3cd-af1ace25e74c on hv-cinder-84890 Jul 22 11:22:55.321745 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [req-59f9844e-40f1-4420-a950-8c7787491efe req-a7d78c77-bc2a-4f6b-822d-36f4e2595622 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035061 Jul 22 11:22:55.322888 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 505/1027] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:22:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:22:55.917481 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-ffc6a79d-f090-40fc-9c88-fca02a812c28 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:22:55.918184 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-ffc6a79d-f090-40fc-9c88-fca02a812c28 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] [instance: 73334795-ca3f-4da7-a3cd-af1ace25e74c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:22:55.925872 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ffc6a79d-f090-40fc-9c88-fca02a812c28 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:55.926316 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ffc6a79d-f090-40fc-9c88-fca02a812c28 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:55.927083 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ffc6a79d-f090-40fc-9c88-fca02a812c28 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:55.927538 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ffc6a79d-f090-40fc-9c88-fca02a812c28 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:56.059451 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-ffc6a79d-f090-40fc-9c88-fca02a812c28 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00ab892a9233421886b849b879bd8a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f756b95ab7da4271a50fa3b1a5276eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:22:56.067095 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-ffc6a79d-f090-40fc-9c88-fca02a812c28 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] 10.222.0.20 "GET /compute/v2.1/servers/73334795-ca3f-4da7-a3cd-af1ace25e74c" status: 200 len: 1319 microversion: 2.1 time: 0.154260 Jul 22 11:22:56.067719 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 523/1028] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:22:55 2022] GET /compute/v2.1/servers/73334795-ca3f-4da7-a3cd-af1ace25e74c => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:22:57.087318 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-40e25584-0d47-4b77-a032-141f1938f618 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:22:57.088999 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-40e25584-0d47-4b77-a032-141f1938f618 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] [instance: 73334795-ca3f-4da7-a3cd-af1ace25e74c] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:22:57.095986 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-40e25584-0d47-4b77-a032-141f1938f618 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:57.096647 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-40e25584-0d47-4b77-a032-141f1938f618 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:57.097620 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-40e25584-0d47-4b77-a032-141f1938f618 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:57.098049 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-40e25584-0d47-4b77-a032-141f1938f618 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:57.255794 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-40e25584-0d47-4b77-a032-141f1938f618 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00ab892a9233421886b849b879bd8a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f756b95ab7da4271a50fa3b1a5276eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:22:57.265584 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-40e25584-0d47-4b77-a032-141f1938f618 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] 10.222.0.20 "GET /compute/v2.1/servers/73334795-ca3f-4da7-a3cd-af1ace25e74c" status: 200 len: 1319 microversion: 2.1 time: 0.183808 Jul 22 11:22:57.266411 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 506/1029] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:22:57 2022] GET /compute/v2.1/servers/73334795-ca3f-4da7-a3cd-af1ace25e74c => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:22:58.282267 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-5313a0b8-5691-4624-a93f-688c1e8c1f6f tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:22:58.283656 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-5313a0b8-5691-4624-a93f-688c1e8c1f6f tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] [instance: 73334795-ca3f-4da7-a3cd-af1ace25e74c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:22:58.290386 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5313a0b8-5691-4624-a93f-688c1e8c1f6f tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:58.290834 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5313a0b8-5691-4624-a93f-688c1e8c1f6f tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:58.291636 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5313a0b8-5691-4624-a93f-688c1e8c1f6f tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:58.292244 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5313a0b8-5691-4624-a93f-688c1e8c1f6f tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:58.486927 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-5313a0b8-5691-4624-a93f-688c1e8c1f6f tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00ab892a9233421886b849b879bd8a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f756b95ab7da4271a50fa3b1a5276eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:22:58.496180 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-5313a0b8-5691-4624-a93f-688c1e8c1f6f tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] 10.222.0.20 "GET /compute/v2.1/servers/73334795-ca3f-4da7-a3cd-af1ace25e74c" status: 200 len: 1319 microversion: 2.1 time: 0.217404 Jul 22 11:22:58.496793 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 524/1030] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:22:58 2022] GET /compute/v2.1/servers/73334795-ca3f-4da7-a3cd-af1ace25e74c => generated 1319 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:22:58.990401 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [req-4890647b-9250-4c24-8b9c-c3f4f5d57fbf req-7ae491b9-04d0-4e67-ba49-c256f8a8eda3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73334795-ca3f-4da7-a3cd-af1ace25e74c", "name": "network-vif-plugged", "status": "completed", "tag": "c8beaed8-70cd-4d5c-982a-92365698836f"}]} {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:22:58.994462 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG dbcounter [-] [117884] Writing DB stats nova_cell0:SELECT=2 {{(pid=117884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:22:58.995417 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG dbcounter [-] [117884] Writing DB stats nova_cell0:SELECT=6 {{(pid=117884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:22:59.004233 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-4890647b-9250-4c24-8b9c-c3f4f5d57fbf req-7ae491b9-04d0-4e67-ba49-c256f8a8eda3 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:59.004702 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-4890647b-9250-4c24-8b9c-c3f4f5d57fbf req-7ae491b9-04d0-4e67-ba49-c256f8a8eda3 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:59.018469 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.compute.server_external_events [req-4890647b-9250-4c24-8b9c-c3f4f5d57fbf req-7ae491b9-04d0-4e67-ba49-c256f8a8eda3 service nova] Creating event network-vif-plugged:c8beaed8-70cd-4d5c-982a-92365698836f for instance 73334795-ca3f-4da7-a3cd-af1ace25e74c on hv-cinder-84890 Jul 22 11:22:59.024790 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [req-4890647b-9250-4c24-8b9c-c3f4f5d57fbf req-7ae491b9-04d0-4e67-ba49-c256f8a8eda3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038660 Jul 22 11:22:59.025694 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 507/1031] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:22:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:22:59.528169 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-7c8f55aa-9fd9-4024-ad52-0fc189da5f71 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:22:59.533137 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-7c8f55aa-9fd9-4024-ad52-0fc189da5f71 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] [instance: 73334795-ca3f-4da7-a3cd-af1ace25e74c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:22:59.573831 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell0:SELECT=2 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:22:59.584590 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7c8f55aa-9fd9-4024-ad52-0fc189da5f71 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:59.588011 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7c8f55aa-9fd9-4024-ad52-0fc189da5f71 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:22:59.589627 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7c8f55aa-9fd9-4024-ad52-0fc189da5f71 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:22:59.593444 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7c8f55aa-9fd9-4024-ad52-0fc189da5f71 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:23:00.002635 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-7c8f55aa-9fd9-4024-ad52-0fc189da5f71 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00ab892a9233421886b849b879bd8a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f756b95ab7da4271a50fa3b1a5276eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:23:00.012417 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-7c8f55aa-9fd9-4024-ad52-0fc189da5f71 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] 10.222.0.20 "GET /compute/v2.1/servers/73334795-ca3f-4da7-a3cd-af1ace25e74c" status: 200 len: 1319 microversion: 2.1 time: 0.500916 Jul 22 11:23:00.013654 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 525/1032] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:22:59 2022] GET /compute/v2.1/servers/73334795-ca3f-4da7-a3cd-af1ace25e74c => generated 1319 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:23:01.036850 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-fc7fd287-4880-43af-979d-9b0e678fbd07 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:23:01.037676 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-fc7fd287-4880-43af-979d-9b0e678fbd07 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] [instance: 73334795-ca3f-4da7-a3cd-af1ace25e74c] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:23:01.048472 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-fc7fd287-4880-43af-979d-9b0e678fbd07 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:23:01.049313 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-fc7fd287-4880-43af-979d-9b0e678fbd07 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:23:01.050201 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-fc7fd287-4880-43af-979d-9b0e678fbd07 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:23:01.050622 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-fc7fd287-4880-43af-979d-9b0e678fbd07 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:23:01.283311 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-fc7fd287-4880-43af-979d-9b0e678fbd07 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00ab892a9233421886b849b879bd8a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f756b95ab7da4271a50fa3b1a5276eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:23:01.292829 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-fc7fd287-4880-43af-979d-9b0e678fbd07 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] 10.222.0.20 "GET /compute/v2.1/servers/73334795-ca3f-4da7-a3cd-af1ace25e74c" status: 200 len: 1508 microversion: 2.1 time: 0.263931 Jul 22 11:23:01.293545 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 508/1033] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:23:01 2022] GET /compute/v2.1/servers/73334795-ca3f-4da7-a3cd-af1ace25e74c => generated 1508 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:23:27.026296 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-54b5d940-5344-485f-b090-af18f2fcadba tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f2237705-236e-4d52-93bb-f0b3fc0500b5", "device": "/dev/sdb"}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:23:27.028064 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-54b5d940-5344-485f-b090-af18f2fcadba tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] [instance: 73334795-ca3f-4da7-a3cd-af1ace25e74c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:23:27.030722 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:23:27.031446 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:23:27.037330 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-54b5d940-5344-485f-b090-af18f2fcadba tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:23:27.037772 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-54b5d940-5344-485f-b090-af18f2fcadba tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:23:27.038546 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-54b5d940-5344-485f-b090-af18f2fcadba tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:23:27.038980 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-54b5d940-5344-485f-b090-af18f2fcadba tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:23:27.286449 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-54b5d940-5344-485f-b090-af18f2fcadba tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] 10.222.0.20 "POST /compute/v2.1/servers/73334795-ca3f-4da7-a3cd-af1ace25e74c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.264196 Jul 22 11:23:27.287090 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 526/1034] 10.222.0.20 () {60 vars in 1322 bytes} [Fri Jul 22 11:23:27 2022] POST /compute/v2.1/servers/73334795-ca3f-4da7-a3cd-af1ace25e74c/os-volume_attachments => generated 194 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:23:40.139221 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG dbcounter [-] [117884] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=117884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:23:40.140179 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG dbcounter [-] [117884] Writing DB stats nova_cell1:SELECT=86 {{(pid=117884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:23:40.362686 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-b7f8d2f2-4647-43ec-8d9c-89e2511eec73 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Action: 'create', calling method: .version_select at 0x7f8445148700>, body: {"keypair": {"name": "tempest-TestShelveInstance-1543274439", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLFww0NjjLLoQHzpA+SgY7YHNLGVjm6HxwedPux9J6Ih0xgH2W38ycxFbdJvPPyDwZdO34lcVam+EEoIVszAqTlLZUeodkiVMrjlJQtIXBMwDrQ8ZOcq/Dl7p87zHuywKw=="}} {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:23:40.381583 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.quota [None req-b7f8d2f2-4647-43ec-8d9c-89e2511eec73 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Getting quotas for project d084bf56f7894fb98a46d7e2cbb34157. Resources: {'key_pairs'} {{(pid=117884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 22 11:23:40.386320 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.quota [None req-b7f8d2f2-4647-43ec-8d9c-89e2511eec73 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Getting quotas for user 11af2fb64a6c4a4ea660196aa90a9c9e and project d084bf56f7894fb98a46d7e2cbb34157. Resources: {'key_pairs'} {{(pid=117884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 22 11:23:40.412035 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-b7f8d2f2-4647-43ec-8d9c-89e2511eec73 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.278782 Jul 22 11:23:40.412654 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 509/1035] 10.222.0.20 () {60 vars in 1158 bytes} [Fri Jul 22 11:23:40 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:23:50.702793 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_api:SELECT=2 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:23:50.703641 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:23:50.708380 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-5c1eeb20-2469-494b-82c7-e339668def79 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:23:50.708985 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-5c1eeb20-2469-494b-82c7-e339668def79 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] [instance: 73334795-ca3f-4da7-a3cd-af1ace25e74c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:23:50.718220 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5c1eeb20-2469-494b-82c7-e339668def79 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:23:50.718679 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5c1eeb20-2469-494b-82c7-e339668def79 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:23:50.719673 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5c1eeb20-2469-494b-82c7-e339668def79 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:23:50.720105 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5c1eeb20-2469-494b-82c7-e339668def79 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:23:50.816652 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.objects.instance [None req-5c1eeb20-2469-494b-82c7-e339668def79 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lazy-loading 'services' on Instance uuid 73334795-ca3f-4da7-a3cd-af1ace25e74c {{(pid=117885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 22 11:23:50.918298 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-5c1eeb20-2469-494b-82c7-e339668def79 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] 10.222.0.20 "DELETE /compute/v2.1/servers/73334795-ca3f-4da7-a3cd-af1ace25e74c/os-volume_attachments/f2237705-236e-4d52-93bb-f0b3fc0500b5" status: 202 len: 0 microversion: 2.1 time: 0.216304 Jul 22 11:23:50.919142 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 527/1036] 10.222.0.20 () {58 vars in 1415 bytes} [Fri Jul 22 11:23:50 2022] DELETE /compute/v2.1/servers/73334795-ca3f-4da7-a3cd-af1ace25e74c/os-volume_attachments/f2237705-236e-4d52-93bb-f0b3fc0500b5 => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 22 11:23:52.066157 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG dbcounter [-] [117884] Writing DB stats nova_cell0:SELECT=4 {{(pid=117884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:23:52.066964 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG dbcounter [-] [117884] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=117884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:23:52.075888 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-6fea0ea4-b942-41e9-af7a-1bc81e046bae tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:23:52.076465 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-6fea0ea4-b942-41e9-af7a-1bc81e046bae tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] [instance: 73334795-ca3f-4da7-a3cd-af1ace25e74c] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:23:52.086532 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-6fea0ea4-b942-41e9-af7a-1bc81e046bae tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:23:52.089790 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-6fea0ea4-b942-41e9-af7a-1bc81e046bae tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:23:52.089790 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-6fea0ea4-b942-41e9-af7a-1bc81e046bae tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:23:52.089790 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-6fea0ea4-b942-41e9-af7a-1bc81e046bae tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:23:52.133068 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-6fea0ea4-b942-41e9-af7a-1bc81e046bae tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] [instance: 73334795-ca3f-4da7-a3cd-af1ace25e74c] Going to try to terminate instance {{(pid=117884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 22 11:23:52.241842 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-6fea0ea4-b942-41e9-af7a-1bc81e046bae tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] 10.222.0.20 "DELETE /compute/v2.1/servers/73334795-ca3f-4da7-a3cd-af1ace25e74c" status: 204 len: 0 microversion: 2.1 time: 0.176444 Jul 22 11:23:52.243327 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 510/1037] 10.222.0.20 () {58 vars in 1238 bytes} [Fri Jul 22 11:23:52 2022] DELETE /compute/v2.1/servers/73334795-ca3f-4da7-a3cd-af1ace25e74c => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 22 11:23:52.255368 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-bbaec594-c7da-46d7-a644-5c12ccd48a6f tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:23:52.256389 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-bbaec594-c7da-46d7-a644-5c12ccd48a6f tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] [instance: 73334795-ca3f-4da7-a3cd-af1ace25e74c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:23:52.266487 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-bbaec594-c7da-46d7-a644-5c12ccd48a6f tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:23:52.266933 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-bbaec594-c7da-46d7-a644-5c12ccd48a6f tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:23:52.268123 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-bbaec594-c7da-46d7-a644-5c12ccd48a6f tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:23:52.268777 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-bbaec594-c7da-46d7-a644-5c12ccd48a6f tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:23:52.452050 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-bbaec594-c7da-46d7-a644-5c12ccd48a6f tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00ab892a9233421886b849b879bd8a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f756b95ab7da4271a50fa3b1a5276eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:23:52.461117 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-bbaec594-c7da-46d7-a644-5c12ccd48a6f tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] 10.222.0.20 "GET /compute/v2.1/servers/73334795-ca3f-4da7-a3cd-af1ace25e74c" status: 200 len: 1514 microversion: 2.1 time: 0.212466 Jul 22 11:23:52.461728 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 528/1038] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:23:52 2022] GET /compute/v2.1/servers/73334795-ca3f-4da7-a3cd-af1ace25e74c => generated 1514 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:23:53.483848 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-efe4a4af-5687-4d88-ba09-6133260f6244 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:23:53.484566 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-efe4a4af-5687-4d88-ba09-6133260f6244 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] [instance: 73334795-ca3f-4da7-a3cd-af1ace25e74c] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:23:53.491639 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-efe4a4af-5687-4d88-ba09-6133260f6244 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:23:53.492320 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-efe4a4af-5687-4d88-ba09-6133260f6244 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:23:53.493097 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-efe4a4af-5687-4d88-ba09-6133260f6244 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:23:53.493538 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-efe4a4af-5687-4d88-ba09-6133260f6244 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:23:53.676400 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-efe4a4af-5687-4d88-ba09-6133260f6244 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00ab892a9233421886b849b879bd8a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f756b95ab7da4271a50fa3b1a5276eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:23:53.687252 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-efe4a4af-5687-4d88-ba09-6133260f6244 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] 10.222.0.20 "GET /compute/v2.1/servers/73334795-ca3f-4da7-a3cd-af1ace25e74c" status: 200 len: 1514 microversion: 2.1 time: 0.209797 Jul 22 11:23:53.688250 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 511/1039] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:23:53 2022] GET /compute/v2.1/servers/73334795-ca3f-4da7-a3cd-af1ace25e74c => generated 1514 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:23:54.600178 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-5b64a6be-dbaa-483d-adad-0c025c8f2264 req-8c792526-12af-4501-a6be-9c97281b9a16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73334795-ca3f-4da7-a3cd-af1ace25e74c", "name": "network-vif-deleted", "tag": "c8beaed8-70cd-4d5c-982a-92365698836f"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:23:54.610655 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-5b64a6be-dbaa-483d-adad-0c025c8f2264 req-8c792526-12af-4501-a6be-9c97281b9a16 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:23:54.611240 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-5b64a6be-dbaa-483d-adad-0c025c8f2264 req-8c792526-12af-4501-a6be-9c97281b9a16 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:23:54.626077 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-5b64a6be-dbaa-483d-adad-0c025c8f2264 req-8c792526-12af-4501-a6be-9c97281b9a16 service nova] Creating event network-vif-deleted:c8beaed8-70cd-4d5c-982a-92365698836f for instance 73334795-ca3f-4da7-a3cd-af1ace25e74c on hv-cinder-84890 Jul 22 11:23:54.631592 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-5b64a6be-dbaa-483d-adad-0c025c8f2264 req-8c792526-12af-4501-a6be-9c97281b9a16 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035798 Jul 22 11:23:54.632170 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 529/1040] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:23:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:23:54.706811 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-77665de2-1909-492c-b790-7698a0995213 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:23:54.708009 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-77665de2-1909-492c-b790-7698a0995213 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] [instance: 73334795-ca3f-4da7-a3cd-af1ace25e74c] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:23:54.716515 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-77665de2-1909-492c-b790-7698a0995213 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:23:54.716961 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-77665de2-1909-492c-b790-7698a0995213 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:23:54.717739 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-77665de2-1909-492c-b790-7698a0995213 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:23:54.718191 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-77665de2-1909-492c-b790-7698a0995213 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:23:54.758889 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-77665de2-1909-492c-b790-7698a0995213 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:23:54.759431 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-77665de2-1909-492c-b790-7698a0995213 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:23:54.759881 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.objects.instance [None req-77665de2-1909-492c-b790-7698a0995213 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lazy-loading 'fault' on Instance uuid 73334795-ca3f-4da7-a3cd-af1ace25e74c {{(pid=117884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 22 11:23:54.807584 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-77665de2-1909-492c-b790-7698a0995213 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00ab892a9233421886b849b879bd8a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f756b95ab7da4271a50fa3b1a5276eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:23:54.822715 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-77665de2-1909-492c-b790-7698a0995213 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] 10.222.0.20 "GET /compute/v2.1/servers/73334795-ca3f-4da7-a3cd-af1ace25e74c" status: 200 len: 1309 microversion: 2.1 time: 0.119602 Jul 22 11:23:54.823764 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 512/1041] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:23:54 2022] GET /compute/v2.1/servers/73334795-ca3f-4da7-a3cd-af1ace25e74c => generated 1309 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:23:55.847315 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-091c5654-3b3d-4adb-81cb-468893ce2ff4 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:23:55.848031 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-091c5654-3b3d-4adb-81cb-468893ce2ff4 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] [instance: 73334795-ca3f-4da7-a3cd-af1ace25e74c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:23:55.854391 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-091c5654-3b3d-4adb-81cb-468893ce2ff4 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:23:55.854842 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-091c5654-3b3d-4adb-81cb-468893ce2ff4 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:23:55.856153 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-091c5654-3b3d-4adb-81cb-468893ce2ff4 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:23:55.856599 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-091c5654-3b3d-4adb-81cb-468893ce2ff4 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:23:55.871252 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.wsgi [None req-091c5654-3b3d-4adb-81cb-468893ce2ff4 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] HTTP exception thrown: Instance 73334795-ca3f-4da7-a3cd-af1ace25e74c could not be found. Jul 22 11:23:55.873467 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-091c5654-3b3d-4adb-81cb-468893ce2ff4 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Request method failure captured: Jul 22 11:23:55.873467 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: request: GET /compute/v2.1/servers/73334795-ca3f-4da7-a3cd-af1ace25e74c HTTP/1.1 Jul 22 11:23:55.873467 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Accept: application/json Jul 22 11:23:55.873467 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Accept-Encoding: identity Jul 22 11:23:55.873467 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Connection: close Jul 22 11:23:55.873467 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Content-Length: 0 Jul 22 11:23:55.873467 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Content-Type: application/json Jul 22 11:23:55.873467 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Host: 10.222.0.20 Jul 22 11:23:55.873467 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Openstack-System-Scope: None Jul 22 11:23:55.873467 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: User-Agent: python-urllib3/1.26.9 Jul 22 11:23:55.873467 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Auth-Token: gAAAAABi2oiGKD6vXJ7-l10lfJIwzQrtxMXMsn-aSU9toSXT7nvYPZvdv0Nmf7LccROJaAyRdaf2LQHNSYIESNkE0rk8XnNst_PDI2iJQ_Me_-EBlcmNGu7dGLB43LM0c97wy5P4abWKOdZ93MSHycA82tMxmzsssvb4jvJxVEqdjzq85A5xmMg Jul 22 11:23:55.873467 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Domain-Id: None Jul 22 11:23:55.873467 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Domain-Name: None Jul 22 11:23:55.873467 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Identity-Status: Confirmed Jul 22 11:23:55.873467 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Is-Admin-Project: True Jul 22 11:23:55.873467 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Project-Domain-Id: default Jul 22 11:23:55.873467 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Project-Domain-Name: Default Jul 22 11:23:55.873467 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Project-Id: f756b95ab7da4271a50fa3b1a5276eea Jul 22 11:23:55.873467 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Project-Name: tempest-VolumesSnapshotTestJSON-822882006 Jul 22 11:23:55.873467 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Role: reader,member Jul 22 11:23:55.873467 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Roles: reader,member Jul 22 11:23:55.875199 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f756b95ab7da4271a50fa3b1a5276eea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f756b95ab7da4271a50fa3b1a5276eea", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f756b95ab7da4271a50fa3b1a5276eea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f756b95ab7da4271a50fa3b1a5276eea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jul 22 11:23:55.875199 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Tenant: tempest-VolumesSnapshotTestJSON-822882006 Jul 22 11:23:55.875199 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Tenant-Id: f756b95ab7da4271a50fa3b1a5276eea Jul 22 11:23:55.875199 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-822882006 Jul 22 11:23:55.875199 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User: tempest-VolumesSnapshotTestJSON-822882006-project Jul 22 11:23:55.875199 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User-Domain-Id: default Jul 22 11:23:55.875199 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User-Domain-Name: Default Jul 22 11:23:55.875199 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User-Id: 00ab892a9233421886b849b879bd8a7e Jul 22 11:23:55.875199 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User-Name: tempest-VolumesSnapshotTestJSON-822882006-project Jul 22 11:23:55.875199 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: method: > Jul 22 11:23:55.875199 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: exception: Instance 73334795-ca3f-4da7-a3cd-af1ace25e74c could not be found. Jul 22 11:23:55.875199 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: action_args: {'id': '73334795-ca3f-4da7-a3cd-af1ace25e74c'} Jul 22 11:23:55.876174 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 22 11:23:55.876174 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:23:55.876174 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 22 11:23:55.876174 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 22 11:23:55.876174 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 22 11:23:55.876174 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 22 11:23:55.876174 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 22 11:23:55.876174 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 22 11:23:55.876174 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 22 11:23:55.876174 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 22 11:23:55.876174 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73334795-ca3f-4da7-a3cd-af1ace25e74c could not be found. Jul 22 11:23:55.876174 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:23:55.876174 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:23:55.876174 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:23:55.876174 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:23:55.876174 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:23:55.876174 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:23:55.876174 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 22 11:23:55.876174 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 22 11:23:55.876174 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 22 11:23:55.877714 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 22 11:23:55.877714 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 22 11:23:55.877714 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 22 11:23:55.877714 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 22 11:23:55.877714 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 22 11:23:55.877714 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 22 11:23:55.877714 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 22 11:23:55.877714 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73334795-ca3f-4da7-a3cd-af1ace25e74c could not be found. Jul 22 11:23:55.877714 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:23:55.877714 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:23:55.877714 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:23:55.877714 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:23:55.877714 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:23:55.877714 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:23:55.877714 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 22 11:23:55.877714 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 22 11:23:55.877714 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73334795-ca3f-4da7-a3cd-af1ace25e74c could not be found. Jul 22 11:23:55.877714 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:23:55.879012 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-091c5654-3b3d-4adb-81cb-468893ce2ff4 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Returning 404 to user: Instance 73334795-ca3f-4da7-a3cd-af1ace25e74c could not be found. {{(pid=117885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 22 11:23:55.879012 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-091c5654-3b3d-4adb-81cb-468893ce2ff4 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] 10.222.0.20 "GET /compute/v2.1/servers/73334795-ca3f-4da7-a3cd-af1ace25e74c" status: 404 len: 111 microversion: 2.1 time: 0.032629 Jul 22 11:23:55.879205 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 530/1042] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:23:55 2022] GET /compute/v2.1/servers/73334795-ca3f-4da7-a3cd-af1ace25e74c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 22 11:24:05.477434 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 22 11:24:05.478273 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Fri Jul 22 11:24:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 22 11:24:07.921952 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-af231b7a-3766-48c4-9166-27a411f4928a tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1937386521", "imageRef": "1a6c3cb4-9f56-44c6-aa68-01000df27209", "flavorRef": "452", "networks": [{"uuid": "21334fc9-8075-4597-ace1-e64a29a68fe1"}]}} {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:24:07.928920 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG dbcounter [-] [117884] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=117884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:24:07.929572 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG dbcounter [-] [117884] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:24:07.977528 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.network.neutron [None req-af231b7a-3766-48c4-9166-27a411f4928a tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] validate_networks() for [('21334fc9-8075-4597-ace1-e64a29a68fe1', None, None, None, None, None)] {{(pid=117884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 22 11:24:08.333418 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.virt.hardware [None req-af231b7a-3766-48c4-9166-27a411f4928a tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Flavor limits 0:0:0 {{(pid=117884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 22 11:24:08.333830 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.virt.hardware [None req-af231b7a-3766-48c4-9166-27a411f4928a tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Image limits 0:0:0 {{(pid=117884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 22 11:24:08.334333 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.virt.hardware [None req-af231b7a-3766-48c4-9166-27a411f4928a tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Flavor pref 0:0:0 {{(pid=117884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 22 11:24:08.334740 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.virt.hardware [None req-af231b7a-3766-48c4-9166-27a411f4928a tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Image pref 0:0:0 {{(pid=117884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 22 11:24:08.335154 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.virt.hardware [None req-af231b7a-3766-48c4-9166-27a411f4928a tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 22 11:24:08.344584 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-af231b7a-3766-48c4-9166-27a411f4928a tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:08.345025 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-af231b7a-3766-48c4-9166-27a411f4928a tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:08.345847 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-af231b7a-3766-48c4-9166-27a411f4928a tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:08.346284 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-af231b7a-3766-48c4-9166-27a411f4928a tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:08.364607 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.quota [None req-af231b7a-3766-48c4-9166-27a411f4928a tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Getting quotas for project f756b95ab7da4271a50fa3b1a5276eea. Resources: {'instances', 'cores', 'ram'} {{(pid=117884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 22 11:24:08.368534 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.quota [None req-af231b7a-3766-48c4-9166-27a411f4928a tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Getting quotas for user 00ab892a9233421886b849b879bd8a7e and project f756b95ab7da4271a50fa3b1a5276eea. Resources: {'instances', 'cores', 'ram'} {{(pid=117884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 22 11:24:08.379531 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-af231b7a-3766-48c4-9166-27a411f4928a tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Going to run 1 instances... {{(pid=117884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 22 11:24:08.381785 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-af231b7a-3766-48c4-9166-27a411f4928a tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] [instance: 9b7a2a09-12e8-478a-8c51-945180dde6c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1a6c3cb4-9f56-44c6-aa68-01000df27209',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 22 11:24:08.429763 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-af231b7a-3766-48c4-9166-27a411f4928a tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.512232 Jul 22 11:24:08.430431 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 513/1043] 10.222.0.20 () {60 vars in 1146 bytes} [Fri Jul 22 11:24:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 514 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 22 11:24:08.440871 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-03c64d15-60f2-4af1-b381-2b146081209e tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:24:08.441498 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-03c64d15-60f2-4af1-b381-2b146081209e tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] [instance: 9b7a2a09-12e8-478a-8c51-945180dde6c4] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:24:08.443582 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_api:SELECT=8 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:24:08.444219 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:24:08.499681 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-03c64d15-60f2-4af1-b381-2b146081209e tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00ab892a9233421886b849b879bd8a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f756b95ab7da4271a50fa3b1a5276eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:24:08.506765 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-03c64d15-60f2-4af1-b381-2b146081209e tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] 10.222.0.20 "GET /compute/v2.1/servers/9b7a2a09-12e8-478a-8c51-945180dde6c4" status: 200 len: 1219 microversion: 2.1 time: 0.069883 Jul 22 11:24:08.507597 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 531/1044] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:24:08 2022] GET /compute/v2.1/servers/9b7a2a09-12e8-478a-8c51-945180dde6c4 => generated 1219 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:24:09.525580 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-aeef1d94-137a-488e-a4b8-faac35a2e1f2 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:24:09.526139 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-aeef1d94-137a-488e-a4b8-faac35a2e1f2 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] [instance: 9b7a2a09-12e8-478a-8c51-945180dde6c4] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:24:09.533446 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-aeef1d94-137a-488e-a4b8-faac35a2e1f2 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:09.533890 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-aeef1d94-137a-488e-a4b8-faac35a2e1f2 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:09.534666 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-aeef1d94-137a-488e-a4b8-faac35a2e1f2 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:09.535095 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-aeef1d94-137a-488e-a4b8-faac35a2e1f2 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:09.597706 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-aeef1d94-137a-488e-a4b8-faac35a2e1f2 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00ab892a9233421886b849b879bd8a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f756b95ab7da4271a50fa3b1a5276eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:24:09.605913 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-aeef1d94-137a-488e-a4b8-faac35a2e1f2 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] 10.222.0.20 "GET /compute/v2.1/servers/9b7a2a09-12e8-478a-8c51-945180dde6c4" status: 200 len: 1223 microversion: 2.1 time: 0.083787 Jul 22 11:24:09.606488 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 514/1045] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:24:09 2022] GET /compute/v2.1/servers/9b7a2a09-12e8-478a-8c51-945180dde6c4 => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:24:10.623779 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-d9a26fb0-5450-4e44-903f-c5f98872ce60 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:24:10.624408 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-d9a26fb0-5450-4e44-903f-c5f98872ce60 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] [instance: 9b7a2a09-12e8-478a-8c51-945180dde6c4] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:24:10.632012 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d9a26fb0-5450-4e44-903f-c5f98872ce60 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:10.632461 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d9a26fb0-5450-4e44-903f-c5f98872ce60 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:10.633244 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d9a26fb0-5450-4e44-903f-c5f98872ce60 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:10.633689 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d9a26fb0-5450-4e44-903f-c5f98872ce60 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:10.702756 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-d9a26fb0-5450-4e44-903f-c5f98872ce60 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00ab892a9233421886b849b879bd8a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f756b95ab7da4271a50fa3b1a5276eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:24:10.710741 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-d9a26fb0-5450-4e44-903f-c5f98872ce60 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] 10.222.0.20 "GET /compute/v2.1/servers/9b7a2a09-12e8-478a-8c51-945180dde6c4" status: 200 len: 1271 microversion: 2.1 time: 0.091398 Jul 22 11:24:10.711344 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 532/1046] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:24:10 2022] GET /compute/v2.1/servers/9b7a2a09-12e8-478a-8c51-945180dde6c4 => generated 1271 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:24:10.859201 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-da8ccc4e-b27a-4768-9c5d-8698c453b1f6 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:24:10.859762 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-da8ccc4e-b27a-4768-9c5d-8698c453b1f6 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] [instance: 36dec2db-4166-4853-a79b-832ad7fc2730] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:24:10.866632 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-da8ccc4e-b27a-4768-9c5d-8698c453b1f6 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:10.867073 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-da8ccc4e-b27a-4768-9c5d-8698c453b1f6 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:10.867844 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-da8ccc4e-b27a-4768-9c5d-8698c453b1f6 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:10.868346 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-da8ccc4e-b27a-4768-9c5d-8698c453b1f6 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:10.896607 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-da8ccc4e-b27a-4768-9c5d-8698c453b1f6 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] [instance: 36dec2db-4166-4853-a79b-832ad7fc2730] Going to try to terminate instance {{(pid=117884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 22 11:24:10.918905 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-720176fd-c808-45ac-9569-710c535ac7d6 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1300826257", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1543274439", "security_groups": [{"name": "tempest-secgroup-smoke-2106888857"}], "networks": [{"uuid": "b3f9de9b-e339-44a8-8d52-963ec66a3e22"}], "block_device_mapping_v2": [{"uuid": "ab70d33d-de3b-44ba-a779-78c6d435af9e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:24:10.982967 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-da8ccc4e-b27a-4768-9c5d-8698c453b1f6 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] 10.222.0.20 "DELETE /compute/v2.1/servers/36dec2db-4166-4853-a79b-832ad7fc2730" status: 204 len: 0 microversion: 2.1 time: 0.127921 Jul 22 11:24:10.983608 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 515/1047] 10.222.0.20 () {58 vars in 1238 bytes} [Fri Jul 22 11:24:10 2022] DELETE /compute/v2.1/servers/36dec2db-4166-4853-a79b-832ad7fc2730 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 22 11:24:10.992624 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-f64e3cc5-56c4-4dea-b805-2ac6125832e0 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:24:10.993376 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-f64e3cc5-56c4-4dea-b805-2ac6125832e0 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] [instance: 36dec2db-4166-4853-a79b-832ad7fc2730] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:24:11.000596 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f64e3cc5-56c4-4dea-b805-2ac6125832e0 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:11.001043 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f64e3cc5-56c4-4dea-b805-2ac6125832e0 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:11.001819 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f64e3cc5-56c4-4dea-b805-2ac6125832e0 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:11.002315 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f64e3cc5-56c4-4dea-b805-2ac6125832e0 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:11.045134 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.network.neutron [None req-720176fd-c808-45ac-9569-710c535ac7d6 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] validate_networks() for [('b3f9de9b-e339-44a8-8d52-963ec66a3e22', None, None, None, None, None)] {{(pid=117885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 22 11:24:11.158594 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-f64e3cc5-56c4-4dea-b805-2ac6125832e0 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a299663b56b411b9fc910ddf47103e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d58bceb8414b02a1bbaec0db07d85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:24:11.166562 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-f64e3cc5-56c4-4dea-b805-2ac6125832e0 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] 10.222.0.20 "GET /compute/v2.1/servers/36dec2db-4166-4853-a79b-832ad7fc2730" status: 200 len: 1578 microversion: 2.1 time: 0.178570 Jul 22 11:24:11.167152 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 516/1048] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:24:10 2022] GET /compute/v2.1/servers/36dec2db-4166-4853-a79b-832ad7fc2730 => generated 1578 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:24:11.458425 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-720176fd-c808-45ac-9569-710c535ac7d6 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Flavor limits 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 22 11:24:11.458856 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-720176fd-c808-45ac-9569-710c535ac7d6 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Image limits 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 22 11:24:11.459395 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-720176fd-c808-45ac-9569-710c535ac7d6 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Flavor pref 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 22 11:24:11.459808 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-720176fd-c808-45ac-9569-710c535ac7d6 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Image pref 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 22 11:24:11.460221 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-720176fd-c808-45ac-9569-710c535ac7d6 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 22 11:24:11.470935 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-720176fd-c808-45ac-9569-710c535ac7d6 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:11.471413 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-720176fd-c808-45ac-9569-710c535ac7d6 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:11.472213 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-720176fd-c808-45ac-9569-710c535ac7d6 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:11.472651 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-720176fd-c808-45ac-9569-710c535ac7d6 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:11.493479 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-720176fd-c808-45ac-9569-710c535ac7d6 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Getting quotas for project d084bf56f7894fb98a46d7e2cbb34157. Resources: {'instances', 'cores', 'ram'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 22 11:24:11.497712 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-720176fd-c808-45ac-9569-710c535ac7d6 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Getting quotas for user 11af2fb64a6c4a4ea660196aa90a9c9e and project d084bf56f7894fb98a46d7e2cbb34157. Resources: {'instances', 'cores', 'ram'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 22 11:24:11.558349 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-720176fd-c808-45ac-9569-710c535ac7d6 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Going to run 1 instances... {{(pid=117885) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 22 11:24:11.560566 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-720176fd-c808-45ac-9569-710c535ac7d6 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] [instance: 3e342bc0-ddb4-4b26-9d31-04210b39c81c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ab70d33d-de3b-44ba-a779-78c6d435af9e',volume_size=None,volume_type=None)] {{(pid=117885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 22 11:24:11.697202 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-720176fd-c808-45ac-9569-710c535ac7d6 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.783888 Jul 22 11:24:11.698135 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 533/1049] 10.222.0.20 () {60 vars in 1146 bytes} [Fri Jul 22 11:24:10 2022] POST /compute/v2.1/servers => generated 406 bytes in 785 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 22 11:24:11.708520 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-18ee5ad6-bb28-4151-a38f-b290bc04040f tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:24:11.709044 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-18ee5ad6-bb28-4151-a38f-b290bc04040f tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] [instance: 3e342bc0-ddb4-4b26-9d31-04210b39c81c] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:24:11.728107 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-01b8948e-7cec-4b67-a705-0447ec3db4e1 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:24:11.728828 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-01b8948e-7cec-4b67-a705-0447ec3db4e1 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] [instance: 9b7a2a09-12e8-478a-8c51-945180dde6c4] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:24:11.735915 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-01b8948e-7cec-4b67-a705-0447ec3db4e1 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:11.736363 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-01b8948e-7cec-4b67-a705-0447ec3db4e1 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:11.737140 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-01b8948e-7cec-4b67-a705-0447ec3db4e1 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:11.737565 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-01b8948e-7cec-4b67-a705-0447ec3db4e1 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:11.771163 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-18ee5ad6-bb28-4151-a38f-b290bc04040f tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af2fb64a6c4a4ea660196aa90a9c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd084bf56f7894fb98a46d7e2cbb34157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:24:11.778945 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-18ee5ad6-bb28-4151-a38f-b290bc04040f tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] 10.222.0.20 "GET /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c" status: 200 len: 1089 microversion: 2.1 time: 0.074294 Jul 22 11:24:11.779564 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 517/1050] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:24:11 2022] GET /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c => generated 1089 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:24:11.804173 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-01b8948e-7cec-4b67-a705-0447ec3db4e1 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00ab892a9233421886b849b879bd8a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f756b95ab7da4271a50fa3b1a5276eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:24:11.811632 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-01b8948e-7cec-4b67-a705-0447ec3db4e1 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] 10.222.0.20 "GET /compute/v2.1/servers/9b7a2a09-12e8-478a-8c51-945180dde6c4" status: 200 len: 1271 microversion: 2.1 time: 0.087370 Jul 22 11:24:11.812220 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 534/1051] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:24:11 2022] GET /compute/v2.1/servers/9b7a2a09-12e8-478a-8c51-945180dde6c4 => generated 1271 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:24:12.185426 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-eaad7f92-a0c8-4cdc-89b4-32b919c4a13d tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:24:12.186086 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-eaad7f92-a0c8-4cdc-89b4-32b919c4a13d tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] [instance: 36dec2db-4166-4853-a79b-832ad7fc2730] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:24:12.193476 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-eaad7f92-a0c8-4cdc-89b4-32b919c4a13d tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:12.193927 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-eaad7f92-a0c8-4cdc-89b4-32b919c4a13d tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:12.194716 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-eaad7f92-a0c8-4cdc-89b4-32b919c4a13d tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:12.195156 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-eaad7f92-a0c8-4cdc-89b4-32b919c4a13d tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:12.334635 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-eaad7f92-a0c8-4cdc-89b4-32b919c4a13d tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a299663b56b411b9fc910ddf47103e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d58bceb8414b02a1bbaec0db07d85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:24:12.342675 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-eaad7f92-a0c8-4cdc-89b4-32b919c4a13d tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] 10.222.0.20 "GET /compute/v2.1/servers/36dec2db-4166-4853-a79b-832ad7fc2730" status: 200 len: 1578 microversion: 2.1 time: 0.162804 Jul 22 11:24:12.343306 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 518/1052] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:24:12 2022] GET /compute/v2.1/servers/36dec2db-4166-4853-a79b-832ad7fc2730 => generated 1578 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:24:12.796842 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-599057e8-a426-4dd7-8340-28606fff3aac tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:24:12.797456 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-599057e8-a426-4dd7-8340-28606fff3aac tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] [instance: 3e342bc0-ddb4-4b26-9d31-04210b39c81c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:24:12.804123 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-599057e8-a426-4dd7-8340-28606fff3aac tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:12.804570 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-599057e8-a426-4dd7-8340-28606fff3aac tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:12.805344 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-599057e8-a426-4dd7-8340-28606fff3aac tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:12.805777 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-599057e8-a426-4dd7-8340-28606fff3aac tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:12.835952 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-1db62451-c43d-4199-b6d4-701f8c5e6c80 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:24:12.836467 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-1db62451-c43d-4199-b6d4-701f8c5e6c80 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] [instance: 9b7a2a09-12e8-478a-8c51-945180dde6c4] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:24:12.843240 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-1db62451-c43d-4199-b6d4-701f8c5e6c80 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:12.843712 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-1db62451-c43d-4199-b6d4-701f8c5e6c80 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:12.844498 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-1db62451-c43d-4199-b6d4-701f8c5e6c80 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:12.844933 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-1db62451-c43d-4199-b6d4-701f8c5e6c80 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:12.870799 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-599057e8-a426-4dd7-8340-28606fff3aac tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af2fb64a6c4a4ea660196aa90a9c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd084bf56f7894fb98a46d7e2cbb34157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:24:12.878534 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-599057e8-a426-4dd7-8340-28606fff3aac tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] 10.222.0.20 "GET /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c" status: 200 len: 1139 microversion: 2.1 time: 0.086194 Jul 22 11:24:12.879117 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 535/1053] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:24:12 2022] GET /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c => generated 1139 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:24:12.914252 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-1db62451-c43d-4199-b6d4-701f8c5e6c80 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00ab892a9233421886b849b879bd8a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f756b95ab7da4271a50fa3b1a5276eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:24:12.923351 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-1db62451-c43d-4199-b6d4-701f8c5e6c80 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] 10.222.0.20 "GET /compute/v2.1/servers/9b7a2a09-12e8-478a-8c51-945180dde6c4" status: 200 len: 1271 microversion: 2.1 time: 0.091175 Jul 22 11:24:12.923946 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 519/1054] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:24:12 2022] GET /compute/v2.1/servers/9b7a2a09-12e8-478a-8c51-945180dde6c4 => generated 1271 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:24:13.359960 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-584bbbee-c2c8-4152-99d3-95b587bc8df8 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:24:13.360564 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-584bbbee-c2c8-4152-99d3-95b587bc8df8 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] [instance: 36dec2db-4166-4853-a79b-832ad7fc2730] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:24:13.366924 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-584bbbee-c2c8-4152-99d3-95b587bc8df8 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:13.367390 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-584bbbee-c2c8-4152-99d3-95b587bc8df8 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:13.368154 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-584bbbee-c2c8-4152-99d3-95b587bc8df8 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:13.368583 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-584bbbee-c2c8-4152-99d3-95b587bc8df8 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:13.520922 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-584bbbee-c2c8-4152-99d3-95b587bc8df8 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a299663b56b411b9fc910ddf47103e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d58bceb8414b02a1bbaec0db07d85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:24:13.529459 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-584bbbee-c2c8-4152-99d3-95b587bc8df8 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] 10.222.0.20 "GET /compute/v2.1/servers/36dec2db-4166-4853-a79b-832ad7fc2730" status: 200 len: 1578 microversion: 2.1 time: 0.173311 Jul 22 11:24:13.530444 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 536/1055] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:24:13 2022] GET /compute/v2.1/servers/36dec2db-4166-4853-a79b-832ad7fc2730 => generated 1578 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:24:13.895886 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-f6d446fb-595a-4e29-b250-b1a9f5d438b4 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:24:13.897267 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-f6d446fb-595a-4e29-b250-b1a9f5d438b4 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] [instance: 3e342bc0-ddb4-4b26-9d31-04210b39c81c] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:24:13.903592 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f6d446fb-595a-4e29-b250-b1a9f5d438b4 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:13.904040 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f6d446fb-595a-4e29-b250-b1a9f5d438b4 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:13.904819 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f6d446fb-595a-4e29-b250-b1a9f5d438b4 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:13.905251 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f6d446fb-595a-4e29-b250-b1a9f5d438b4 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:13.940957 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-82058e25-852f-4b79-a9e1-d3a97d798818 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:24:13.941743 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-82058e25-852f-4b79-a9e1-d3a97d798818 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] [instance: 9b7a2a09-12e8-478a-8c51-945180dde6c4] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:24:13.949077 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-82058e25-852f-4b79-a9e1-d3a97d798818 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:13.949660 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-82058e25-852f-4b79-a9e1-d3a97d798818 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:13.950705 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-82058e25-852f-4b79-a9e1-d3a97d798818 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:13.951266 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-82058e25-852f-4b79-a9e1-d3a97d798818 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:13.972998 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-f6d446fb-595a-4e29-b250-b1a9f5d438b4 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af2fb64a6c4a4ea660196aa90a9c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd084bf56f7894fb98a46d7e2cbb34157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:24:13.981646 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-f6d446fb-595a-4e29-b250-b1a9f5d438b4 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] 10.222.0.20 "GET /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c" status: 200 len: 1139 microversion: 2.1 time: 0.090110 Jul 22 11:24:13.982582 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 520/1056] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:24:13 2022] GET /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c => generated 1139 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:24:14.020723 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-82058e25-852f-4b79-a9e1-d3a97d798818 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00ab892a9233421886b849b879bd8a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f756b95ab7da4271a50fa3b1a5276eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:24:14.028515 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-82058e25-852f-4b79-a9e1-d3a97d798818 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] 10.222.0.20 "GET /compute/v2.1/servers/9b7a2a09-12e8-478a-8c51-945180dde6c4" status: 200 len: 1271 microversion: 2.1 time: 0.092028 Jul 22 11:24:14.029096 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 537/1057] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:24:13 2022] GET /compute/v2.1/servers/9b7a2a09-12e8-478a-8c51-945180dde6c4 => generated 1271 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:24:14.546263 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-1eabf19c-2eb9-4a06-a16e-9de8335bbc68 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:24:14.546878 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-1eabf19c-2eb9-4a06-a16e-9de8335bbc68 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] [instance: 36dec2db-4166-4853-a79b-832ad7fc2730] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:24:14.553073 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-1eabf19c-2eb9-4a06-a16e-9de8335bbc68 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:14.553520 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-1eabf19c-2eb9-4a06-a16e-9de8335bbc68 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:14.554291 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-1eabf19c-2eb9-4a06-a16e-9de8335bbc68 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:14.554729 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-1eabf19c-2eb9-4a06-a16e-9de8335bbc68 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:14.787388 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-1eabf19c-2eb9-4a06-a16e-9de8335bbc68 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a299663b56b411b9fc910ddf47103e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d58bceb8414b02a1bbaec0db07d85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:24:14.797087 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-1eabf19c-2eb9-4a06-a16e-9de8335bbc68 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] 10.222.0.20 "GET /compute/v2.1/servers/36dec2db-4166-4853-a79b-832ad7fc2730" status: 200 len: 1578 microversion: 2.1 time: 0.254912 Jul 22 11:24:14.797944 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 521/1058] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:24:14 2022] GET /compute/v2.1/servers/36dec2db-4166-4853-a79b-832ad7fc2730 => generated 1578 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:24:14.999751 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-1ddadcef-0a6e-4e7e-945b-2fdb5a07a8f8 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:24:15.000445 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-1ddadcef-0a6e-4e7e-945b-2fdb5a07a8f8 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] [instance: 3e342bc0-ddb4-4b26-9d31-04210b39c81c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:24:15.006830 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1ddadcef-0a6e-4e7e-945b-2fdb5a07a8f8 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:15.008037 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1ddadcef-0a6e-4e7e-945b-2fdb5a07a8f8 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:15.008173 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1ddadcef-0a6e-4e7e-945b-2fdb5a07a8f8 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:15.008520 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1ddadcef-0a6e-4e7e-945b-2fdb5a07a8f8 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:15.045493 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-6cfc0c84-c496-436f-819a-08b5c20965fb tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:24:15.046372 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-6cfc0c84-c496-436f-819a-08b5c20965fb tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] [instance: 9b7a2a09-12e8-478a-8c51-945180dde6c4] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:24:15.053979 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-6cfc0c84-c496-436f-819a-08b5c20965fb tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:15.054803 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-6cfc0c84-c496-436f-819a-08b5c20965fb tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:15.055886 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-6cfc0c84-c496-436f-819a-08b5c20965fb tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:15.056383 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-6cfc0c84-c496-436f-819a-08b5c20965fb tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:15.093901 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-1ddadcef-0a6e-4e7e-945b-2fdb5a07a8f8 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af2fb64a6c4a4ea660196aa90a9c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd084bf56f7894fb98a46d7e2cbb34157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:24:15.104874 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-1ddadcef-0a6e-4e7e-945b-2fdb5a07a8f8 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] 10.222.0.20 "GET /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c" status: 200 len: 1187 microversion: 2.1 time: 0.108939 Jul 22 11:24:15.106644 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 538/1059] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:24:14 2022] GET /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c => generated 1187 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:24:15.149054 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-6cfc0c84-c496-436f-819a-08b5c20965fb tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00ab892a9233421886b849b879bd8a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f756b95ab7da4271a50fa3b1a5276eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:24:15.157691 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-6cfc0c84-c496-436f-819a-08b5c20965fb tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] 10.222.0.20 "GET /compute/v2.1/servers/9b7a2a09-12e8-478a-8c51-945180dde6c4" status: 200 len: 1277 microversion: 2.1 time: 0.116353 Jul 22 11:24:15.158278 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 522/1060] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:24:15 2022] GET /compute/v2.1/servers/9b7a2a09-12e8-478a-8c51-945180dde6c4 => generated 1277 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:24:15.818885 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-70c7c9ce-8eac-477c-9917-777f4bb40035 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:24:15.819316 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-70c7c9ce-8eac-477c-9917-777f4bb40035 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] [instance: 36dec2db-4166-4853-a79b-832ad7fc2730] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:24:15.825523 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-70c7c9ce-8eac-477c-9917-777f4bb40035 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:15.825982 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-70c7c9ce-8eac-477c-9917-777f4bb40035 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:15.826770 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-70c7c9ce-8eac-477c-9917-777f4bb40035 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:15.827206 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-70c7c9ce-8eac-477c-9917-777f4bb40035 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:16.063109 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-70c7c9ce-8eac-477c-9917-777f4bb40035 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a299663b56b411b9fc910ddf47103e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d58bceb8414b02a1bbaec0db07d85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:24:16.072068 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-70c7c9ce-8eac-477c-9917-777f4bb40035 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] 10.222.0.20 "GET /compute/v2.1/servers/36dec2db-4166-4853-a79b-832ad7fc2730" status: 200 len: 1578 microversion: 2.1 time: 0.257427 Jul 22 11:24:16.082766 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 539/1061] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:24:15 2022] GET /compute/v2.1/servers/36dec2db-4166-4853-a79b-832ad7fc2730 => generated 1578 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:24:16.128041 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-664df0af-47a5-408a-a38e-cd5bd1e4a831 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:24:16.131009 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-664df0af-47a5-408a-a38e-cd5bd1e4a831 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] [instance: 3e342bc0-ddb4-4b26-9d31-04210b39c81c] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:24:16.142325 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-664df0af-47a5-408a-a38e-cd5bd1e4a831 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:16.142897 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-664df0af-47a5-408a-a38e-cd5bd1e4a831 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:16.144524 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-664df0af-47a5-408a-a38e-cd5bd1e4a831 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:16.145285 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-664df0af-47a5-408a-a38e-cd5bd1e4a831 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:16.176530 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-3dace255-e027-4f91-b18f-6677c26e8464 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:24:16.178268 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-3dace255-e027-4f91-b18f-6677c26e8464 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] [instance: 9b7a2a09-12e8-478a-8c51-945180dde6c4] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:24:16.190638 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3dace255-e027-4f91-b18f-6677c26e8464 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:16.191412 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3dace255-e027-4f91-b18f-6677c26e8464 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:16.193596 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3dace255-e027-4f91-b18f-6677c26e8464 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:16.194327 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3dace255-e027-4f91-b18f-6677c26e8464 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:16.470262 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-3dace255-e027-4f91-b18f-6677c26e8464 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00ab892a9233421886b849b879bd8a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f756b95ab7da4271a50fa3b1a5276eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:24:16.483997 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-3dace255-e027-4f91-b18f-6677c26e8464 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] 10.222.0.20 "GET /compute/v2.1/servers/9b7a2a09-12e8-478a-8c51-945180dde6c4" status: 200 len: 1319 microversion: 2.1 time: 0.311241 Jul 22 11:24:16.488150 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-664df0af-47a5-408a-a38e-cd5bd1e4a831 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af2fb64a6c4a4ea660196aa90a9c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd084bf56f7894fb98a46d7e2cbb34157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:24:16.501342 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 540/1062] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:24:16 2022] GET /compute/v2.1/servers/9b7a2a09-12e8-478a-8c51-945180dde6c4 => generated 1319 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:24:16.510157 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-664df0af-47a5-408a-a38e-cd5bd1e4a831 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] 10.222.0.20 "GET /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c" status: 200 len: 1261 microversion: 2.1 time: 0.387042 Jul 22 11:24:16.525024 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 523/1063] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:24:16 2022] GET /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c => generated 1261 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:24:17.032369 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-e01e1179-c138-4c5a-ac89-b63644617115 req-32c629d1-6221-442f-b8dc-fe319a0b750e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e342bc0-ddb4-4b26-9d31-04210b39c81c", "tag": "05eda950-e6f4-4f38-86a7-bf112af47c3b"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:24:17.048197 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-e01e1179-c138-4c5a-ac89-b63644617115 req-32c629d1-6221-442f-b8dc-fe319a0b750e service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:17.048641 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-e01e1179-c138-4c5a-ac89-b63644617115 req-32c629d1-6221-442f-b8dc-fe319a0b750e service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:17.090529 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-7ce0148b-6a98-4f17-853d-bd2828cac65b tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:24:17.091159 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-7ce0148b-6a98-4f17-853d-bd2828cac65b tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] [instance: 36dec2db-4166-4853-a79b-832ad7fc2730] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:24:17.100646 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-e01e1179-c138-4c5a-ac89-b63644617115 req-32c629d1-6221-442f-b8dc-fe319a0b750e service nova] Creating event network-changed:05eda950-e6f4-4f38-86a7-bf112af47c3b for instance 3e342bc0-ddb4-4b26-9d31-04210b39c81c on hv-cinder-84890 Jul 22 11:24:17.103240 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-7ce0148b-6a98-4f17-853d-bd2828cac65b tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:17.103713 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-7ce0148b-6a98-4f17-853d-bd2828cac65b tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:17.108335 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-7ce0148b-6a98-4f17-853d-bd2828cac65b tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:17.108777 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-7ce0148b-6a98-4f17-853d-bd2828cac65b tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:17.122467 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-e01e1179-c138-4c5a-ac89-b63644617115 req-32c629d1-6221-442f-b8dc-fe319a0b750e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092587 Jul 22 11:24:17.122467 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 541/1064] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:24:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:24:17.275647 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-7ce0148b-6a98-4f17-853d-bd2828cac65b tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a299663b56b411b9fc910ddf47103e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d58bceb8414b02a1bbaec0db07d85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:24:17.292289 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-7ce0148b-6a98-4f17-853d-bd2828cac65b tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] 10.222.0.20 "GET /compute/v2.1/servers/36dec2db-4166-4853-a79b-832ad7fc2730" status: 200 len: 1510 microversion: 2.1 time: 0.203410 Jul 22 11:24:17.311421 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 524/1065] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:24:17 2022] GET /compute/v2.1/servers/36dec2db-4166-4853-a79b-832ad7fc2730 => generated 1510 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:24:17.326606 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-bb68a81e-165e-4b69-86e4-b3ed0037a4b4 req-a29bc58a-3517-4017-8ce2-663b9a5a534b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b7a2a09-12e8-478a-8c51-945180dde6c4", "tag": "4956a75d-dbdd-40c1-8cc6-d93b31e25c30"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:24:17.342216 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-bb68a81e-165e-4b69-86e4-b3ed0037a4b4 req-a29bc58a-3517-4017-8ce2-663b9a5a534b service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:17.344525 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-bb68a81e-165e-4b69-86e4-b3ed0037a4b4 req-a29bc58a-3517-4017-8ce2-663b9a5a534b service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:17.376009 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-bb68a81e-165e-4b69-86e4-b3ed0037a4b4 req-a29bc58a-3517-4017-8ce2-663b9a5a534b service nova] Creating event network-changed:4956a75d-dbdd-40c1-8cc6-d93b31e25c30 for instance 9b7a2a09-12e8-478a-8c51-945180dde6c4 on hv-cinder-84890 Jul 22 11:24:17.395329 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-bb68a81e-165e-4b69-86e4-b3ed0037a4b4 req-a29bc58a-3517-4017-8ce2-663b9a5a534b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075674 Jul 22 11:24:17.404634 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 542/1066] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:24:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:24:17.501322 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-9d85221a-31be-4229-9221-b2c8326d30d9 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:24:17.502662 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-9d85221a-31be-4229-9221-b2c8326d30d9 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] [instance: 9b7a2a09-12e8-478a-8c51-945180dde6c4] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:24:17.521546 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-9d85221a-31be-4229-9221-b2c8326d30d9 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:17.522253 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-9d85221a-31be-4229-9221-b2c8326d30d9 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:17.523192 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-9d85221a-31be-4229-9221-b2c8326d30d9 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:17.523958 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-9d85221a-31be-4229-9221-b2c8326d30d9 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:17.539557 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-a1533397-b25e-4073-9068-4ad140dbed8a tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:24:17.542949 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-a1533397-b25e-4073-9068-4ad140dbed8a tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] [instance: 3e342bc0-ddb4-4b26-9d31-04210b39c81c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:24:17.569131 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a1533397-b25e-4073-9068-4ad140dbed8a tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:17.570221 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a1533397-b25e-4073-9068-4ad140dbed8a tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:17.571363 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a1533397-b25e-4073-9068-4ad140dbed8a tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:17.571969 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a1533397-b25e-4073-9068-4ad140dbed8a tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:17.850007 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-a1533397-b25e-4073-9068-4ad140dbed8a tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af2fb64a6c4a4ea660196aa90a9c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd084bf56f7894fb98a46d7e2cbb34157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:24:17.862521 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-a1533397-b25e-4073-9068-4ad140dbed8a tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] 10.222.0.20 "GET /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c" status: 200 len: 1261 microversion: 2.1 time: 0.335702 Jul 22 11:24:17.864463 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 543/1067] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:24:17 2022] GET /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c => generated 1261 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:24:17.900022 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-9d85221a-31be-4229-9221-b2c8326d30d9 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00ab892a9233421886b849b879bd8a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f756b95ab7da4271a50fa3b1a5276eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:24:17.915959 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-9d85221a-31be-4229-9221-b2c8326d30d9 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] 10.222.0.20 "GET /compute/v2.1/servers/9b7a2a09-12e8-478a-8c51-945180dde6c4" status: 200 len: 1319 microversion: 2.1 time: 0.418350 Jul 22 11:24:17.926424 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 525/1068] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:24:17 2022] GET /compute/v2.1/servers/9b7a2a09-12e8-478a-8c51-945180dde6c4 => generated 1319 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:24:18.310758 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-4c923365-94d4-4318-aef4-a11950a463c2 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:24:18.312006 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-4c923365-94d4-4318-aef4-a11950a463c2 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] [instance: 36dec2db-4166-4853-a79b-832ad7fc2730] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:24:18.319633 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4c923365-94d4-4318-aef4-a11950a463c2 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:18.320124 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4c923365-94d4-4318-aef4-a11950a463c2 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:18.320886 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4c923365-94d4-4318-aef4-a11950a463c2 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:18.321327 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4c923365-94d4-4318-aef4-a11950a463c2 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:18.358132 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4c923365-94d4-4318-aef4-a11950a463c2 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:18.358573 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4c923365-94d4-4318-aef4-a11950a463c2 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:18.359022 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.objects.instance [None req-4c923365-94d4-4318-aef4-a11950a463c2 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lazy-loading 'fault' on Instance uuid 36dec2db-4166-4853-a79b-832ad7fc2730 {{(pid=117885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 22 11:24:18.402544 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-4c923365-94d4-4318-aef4-a11950a463c2 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a299663b56b411b9fc910ddf47103e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d58bceb8414b02a1bbaec0db07d85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:24:18.410826 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-4c923365-94d4-4318-aef4-a11950a463c2 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] 10.222.0.20 "GET /compute/v2.1/servers/36dec2db-4166-4853-a79b-832ad7fc2730" status: 200 len: 1230 microversion: 2.1 time: 0.104465 Jul 22 11:24:18.411803 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 544/1069] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:24:18 2022] GET /compute/v2.1/servers/36dec2db-4166-4853-a79b-832ad7fc2730 => generated 1230 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:24:18.880868 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-a1a4cf65-92d5-441e-927b-45e9e2fde50f tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:24:18.881465 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-a1a4cf65-92d5-441e-927b-45e9e2fde50f tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] [instance: 3e342bc0-ddb4-4b26-9d31-04210b39c81c] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:24:18.883945 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG dbcounter [-] [117884] Writing DB stats nova_cell0:SELECT=2 {{(pid=117884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:24:18.889842 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-a1a4cf65-92d5-441e-927b-45e9e2fde50f tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:18.890441 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-a1a4cf65-92d5-441e-927b-45e9e2fde50f tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:18.891698 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-a1a4cf65-92d5-441e-927b-45e9e2fde50f tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:18.891698 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-a1a4cf65-92d5-441e-927b-45e9e2fde50f tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:18.933587 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-a2d3d763-e8d5-4058-91c0-fb072819d6af tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:24:18.934514 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-a2d3d763-e8d5-4058-91c0-fb072819d6af tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] [instance: 9b7a2a09-12e8-478a-8c51-945180dde6c4] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:24:18.941388 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a2d3d763-e8d5-4058-91c0-fb072819d6af tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:18.942266 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a2d3d763-e8d5-4058-91c0-fb072819d6af tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:18.943238 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a2d3d763-e8d5-4058-91c0-fb072819d6af tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:18.943860 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a2d3d763-e8d5-4058-91c0-fb072819d6af tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:19.047848 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-a1a4cf65-92d5-441e-927b-45e9e2fde50f tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af2fb64a6c4a4ea660196aa90a9c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd084bf56f7894fb98a46d7e2cbb34157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:24:19.058636 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-a1a4cf65-92d5-441e-927b-45e9e2fde50f tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] 10.222.0.20 "GET /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c" status: 200 len: 1261 microversion: 2.1 time: 0.181567 Jul 22 11:24:19.067379 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 526/1070] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:24:18 2022] GET /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c => generated 1261 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:24:19.103012 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-a2d3d763-e8d5-4058-91c0-fb072819d6af tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00ab892a9233421886b849b879bd8a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f756b95ab7da4271a50fa3b1a5276eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:24:19.112628 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-a2d3d763-e8d5-4058-91c0-fb072819d6af tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] 10.222.0.20 "GET /compute/v2.1/servers/9b7a2a09-12e8-478a-8c51-945180dde6c4" status: 200 len: 1319 microversion: 2.1 time: 0.182765 Jul 22 11:24:19.113238 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 545/1071] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:24:18 2022] GET /compute/v2.1/servers/9b7a2a09-12e8-478a-8c51-945180dde6c4 => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:24:19.429039 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-00c14c3d-e689-41b1-ae51-12b5252b8706 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:24:19.430195 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-00c14c3d-e689-41b1-ae51-12b5252b8706 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] [instance: 36dec2db-4166-4853-a79b-832ad7fc2730] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:24:19.439227 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-00c14c3d-e689-41b1-ae51-12b5252b8706 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:19.439940 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-00c14c3d-e689-41b1-ae51-12b5252b8706 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:19.440801 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-00c14c3d-e689-41b1-ae51-12b5252b8706 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:19.441308 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-00c14c3d-e689-41b1-ae51-12b5252b8706 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:19.458236 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.wsgi [None req-00c14c3d-e689-41b1-ae51-12b5252b8706 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] HTTP exception thrown: Instance 36dec2db-4166-4853-a79b-832ad7fc2730 could not be found. Jul 22 11:24:19.459939 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-00c14c3d-e689-41b1-ae51-12b5252b8706 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Request method failure captured: Jul 22 11:24:19.459939 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: request: GET /compute/v2.1/servers/36dec2db-4166-4853-a79b-832ad7fc2730 HTTP/1.1 Jul 22 11:24:19.459939 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Accept: application/json Jul 22 11:24:19.459939 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Accept-Encoding: identity Jul 22 11:24:19.459939 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Connection: close Jul 22 11:24:19.459939 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Content-Length: 0 Jul 22 11:24:19.459939 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Content-Type: application/json Jul 22 11:24:19.459939 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Host: 10.222.0.20 Jul 22 11:24:19.459939 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Openstack-System-Scope: None Jul 22 11:24:19.459939 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: User-Agent: python-urllib3/1.26.9 Jul 22 11:24:19.459939 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Auth-Token: gAAAAABi2ogmjCFN35PTqtlSgpzQ3l-UABdR039uflNNLPXRj34zwogXxHD0YrMhGDqkpC-lSYaWWXD9Ourj5sd0cDYhOo4wH_3Zbrg-XP_OtyRG6zW9e4tlfhNmHiuhlX2-eN9xtNmSRwHt3dkRVw7OBbkq9qvey7w3mJqVlifrSPb4U_5pqqg Jul 22 11:24:19.459939 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Domain-Id: None Jul 22 11:24:19.459939 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Domain-Name: None Jul 22 11:24:19.459939 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Identity-Status: Confirmed Jul 22 11:24:19.459939 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Is-Admin-Project: True Jul 22 11:24:19.459939 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Domain-Id: default Jul 22 11:24:19.459939 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Domain-Name: Default Jul 22 11:24:19.459939 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Id: 04d58bceb8414b02a1bbaec0db07d85e Jul 22 11:24:19.459939 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Name: tempest-TestVolumeBootPattern-945725022 Jul 22 11:24:19.459939 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Role: reader,member Jul 22 11:24:19.459939 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Roles: reader,member Jul 22 11:24:19.461440 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/04d58bceb8414b02a1bbaec0db07d85e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_04d58bceb8414b02a1bbaec0db07d85e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/04d58bceb8414b02a1bbaec0db07d85e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/04d58bceb8414b02a1bbaec0db07d85e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jul 22 11:24:19.461440 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant: tempest-TestVolumeBootPattern-945725022 Jul 22 11:24:19.461440 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant-Id: 04d58bceb8414b02a1bbaec0db07d85e Jul 22 11:24:19.461440 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant-Name: tempest-TestVolumeBootPattern-945725022 Jul 22 11:24:19.461440 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User: tempest-TestVolumeBootPattern-945725022-project Jul 22 11:24:19.461440 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Domain-Id: default Jul 22 11:24:19.461440 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Domain-Name: Default Jul 22 11:24:19.461440 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Id: 1a299663b56b411b9fc910ddf47103e5 Jul 22 11:24:19.461440 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Name: tempest-TestVolumeBootPattern-945725022-project Jul 22 11:24:19.461440 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: method: > Jul 22 11:24:19.461440 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: exception: Instance 36dec2db-4166-4853-a79b-832ad7fc2730 could not be found. Jul 22 11:24:19.461440 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: action_args: {'id': '36dec2db-4166-4853-a79b-832ad7fc2730'} Jul 22 11:24:19.462317 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 22 11:24:19.462317 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:24:19.462317 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 22 11:24:19.462317 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 22 11:24:19.462317 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 22 11:24:19.462317 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 22 11:24:19.462317 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 22 11:24:19.462317 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 22 11:24:19.462317 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 22 11:24:19.462317 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 22 11:24:19.462317 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36dec2db-4166-4853-a79b-832ad7fc2730 could not be found. Jul 22 11:24:19.462317 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:24:19.462317 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:24:19.462317 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:24:19.462317 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:24:19.462317 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:24:19.462317 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:24:19.462317 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 22 11:24:19.462317 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 22 11:24:19.462317 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 22 11:24:19.463715 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 22 11:24:19.463715 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 22 11:24:19.463715 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 22 11:24:19.463715 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 22 11:24:19.463715 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 22 11:24:19.463715 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 22 11:24:19.463715 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 22 11:24:19.463715 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36dec2db-4166-4853-a79b-832ad7fc2730 could not be found. Jul 22 11:24:19.463715 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:24:19.463715 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:24:19.463715 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:24:19.463715 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:24:19.463715 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:24:19.463715 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:24:19.463715 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 22 11:24:19.463715 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 22 11:24:19.463715 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36dec2db-4166-4853-a79b-832ad7fc2730 could not be found. Jul 22 11:24:19.463715 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:24:19.466399 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-00c14c3d-e689-41b1-ae51-12b5252b8706 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Returning 404 to user: Instance 36dec2db-4166-4853-a79b-832ad7fc2730 could not be found. {{(pid=117884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 22 11:24:19.466399 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-00c14c3d-e689-41b1-ae51-12b5252b8706 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] 10.222.0.20 "GET /compute/v2.1/servers/36dec2db-4166-4853-a79b-832ad7fc2730" status: 404 len: 111 microversion: 2.1 time: 0.036455 Jul 22 11:24:19.470970 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 527/1072] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:24:19 2022] GET /compute/v2.1/servers/36dec2db-4166-4853-a79b-832ad7fc2730 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 22 11:24:19.489151 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-859bec0f-63a6-4c65-9337-d3ef0a5ad632 req-405b0acd-f331-4d7a-9788-accaea12b7c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36dec2db-4166-4853-a79b-832ad7fc2730", "name": "network-vif-deleted", "tag": "de8e5933-745f-42ff-8fcb-dde4aff354a3"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:24:19.501629 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-859bec0f-63a6-4c65-9337-d3ef0a5ad632 req-405b0acd-f331-4d7a-9788-accaea12b7c1 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:19.502549 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-859bec0f-63a6-4c65-9337-d3ef0a5ad632 req-405b0acd-f331-4d7a-9788-accaea12b7c1 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:19.517151 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-859bec0f-63a6-4c65-9337-d3ef0a5ad632 req-405b0acd-f331-4d7a-9788-accaea12b7c1 service nova] Creating event network-vif-deleted:de8e5933-745f-42ff-8fcb-dde4aff354a3 for instance 36dec2db-4166-4853-a79b-832ad7fc2730 on hv-cinder-84890 Jul 22 11:24:19.522550 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-859bec0f-63a6-4c65-9337-d3ef0a5ad632 req-405b0acd-f331-4d7a-9788-accaea12b7c1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037053 Jul 22 11:24:19.523969 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 546/1073] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:24:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:24:19.595476 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-96dcdab1-2aa4-4624-bdab-954977d052ea tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2126156829", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-600883544", "security_groups": [{"name": "tempest-secgroup-smoke-1266173586"}], "block_device_mapping_v2": [{"uuid": "33823faa-9a64-4741-a6cf-16e8dae4c838", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "050b1084-bd00-4a10-81b9-1276e2d9b4d8"}]}} {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:24:19.755530 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.network.neutron [None req-96dcdab1-2aa4-4624-bdab-954977d052ea tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] validate_networks() for [('050b1084-bd00-4a10-81b9-1276e2d9b4d8', None, None, None, None, None)] {{(pid=117884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 22 11:24:20.081886 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-e05e81c8-0e84-400a-93a0-a88d90e3f675 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:24:20.083007 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-e05e81c8-0e84-400a-93a0-a88d90e3f675 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] [instance: 3e342bc0-ddb4-4b26-9d31-04210b39c81c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:24:20.090276 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e05e81c8-0e84-400a-93a0-a88d90e3f675 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:20.091104 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e05e81c8-0e84-400a-93a0-a88d90e3f675 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:20.092137 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e05e81c8-0e84-400a-93a0-a88d90e3f675 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:20.092812 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e05e81c8-0e84-400a-93a0-a88d90e3f675 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:20.248623 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.virt.hardware [None req-96dcdab1-2aa4-4624-bdab-954977d052ea tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Flavor limits 0:0:0 {{(pid=117884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 22 11:24:20.249350 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.virt.hardware [None req-96dcdab1-2aa4-4624-bdab-954977d052ea tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Image limits 0:0:0 {{(pid=117884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 22 11:24:20.250136 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.virt.hardware [None req-96dcdab1-2aa4-4624-bdab-954977d052ea tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Flavor pref 0:0:0 {{(pid=117884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 22 11:24:20.250971 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.virt.hardware [None req-96dcdab1-2aa4-4624-bdab-954977d052ea tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Image pref 0:0:0 {{(pid=117884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 22 11:24:20.251523 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.virt.hardware [None req-96dcdab1-2aa4-4624-bdab-954977d052ea tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 22 11:24:20.258344 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-e05e81c8-0e84-400a-93a0-a88d90e3f675 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af2fb64a6c4a4ea660196aa90a9c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd084bf56f7894fb98a46d7e2cbb34157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:24:20.263965 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-96dcdab1-2aa4-4624-bdab-954977d052ea tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:20.264690 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-96dcdab1-2aa4-4624-bdab-954977d052ea tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:20.265520 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-96dcdab1-2aa4-4624-bdab-954977d052ea tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:20.265932 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-e05e81c8-0e84-400a-93a0-a88d90e3f675 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] 10.222.0.20 "GET /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c" status: 200 len: 1261 microversion: 2.1 time: 0.194268 Jul 22 11:24:20.266085 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-96dcdab1-2aa4-4624-bdab-954977d052ea tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:20.266524 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 547/1074] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:24:20 2022] GET /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c => generated 1261 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:24:20.271053 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-914274bf-6f83-47c7-ad8f-329d647d3075 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:24:20.271696 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-914274bf-6f83-47c7-ad8f-329d647d3075 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] [instance: 9b7a2a09-12e8-478a-8c51-945180dde6c4] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:24:20.278697 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-914274bf-6f83-47c7-ad8f-329d647d3075 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:20.279002 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-914274bf-6f83-47c7-ad8f-329d647d3075 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:20.279814 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-914274bf-6f83-47c7-ad8f-329d647d3075 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:20.280256 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-914274bf-6f83-47c7-ad8f-329d647d3075 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:20.285833 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.quota [None req-96dcdab1-2aa4-4624-bdab-954977d052ea tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Getting quotas for project 04d58bceb8414b02a1bbaec0db07d85e. Resources: {'instances', 'cores', 'ram'} {{(pid=117884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 22 11:24:20.290032 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.quota [None req-96dcdab1-2aa4-4624-bdab-954977d052ea tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Getting quotas for user 1a299663b56b411b9fc910ddf47103e5 and project 04d58bceb8414b02a1bbaec0db07d85e. Resources: {'instances', 'cores', 'ram'} {{(pid=117884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 22 11:24:20.355531 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-96dcdab1-2aa4-4624-bdab-954977d052ea tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Going to run 1 instances... {{(pid=117884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 22 11:24:20.357688 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-96dcdab1-2aa4-4624-bdab-954977d052ea tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] [instance: 03c80c2f-d64d-4b77-86f6-81f65e6752aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='33823faa-9a64-4741-a6cf-16e8dae4c838',volume_size=None,volume_type=None)] {{(pid=117884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 22 11:24:20.420123 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-914274bf-6f83-47c7-ad8f-329d647d3075 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00ab892a9233421886b849b879bd8a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f756b95ab7da4271a50fa3b1a5276eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:24:20.428442 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-914274bf-6f83-47c7-ad8f-329d647d3075 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] 10.222.0.20 "GET /compute/v2.1/servers/9b7a2a09-12e8-478a-8c51-945180dde6c4" status: 200 len: 1319 microversion: 2.1 time: 0.160824 Jul 22 11:24:20.428957 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 548/1075] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:24:20 2022] GET /compute/v2.1/servers/9b7a2a09-12e8-478a-8c51-945180dde6c4 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:24:20.504459 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-96dcdab1-2aa4-4624-bdab-954977d052ea tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.915850 Jul 22 11:24:20.505274 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 528/1076] 10.222.0.20 () {60 vars in 1146 bytes} [Fri Jul 22 11:24:19 2022] POST /compute/v2.1/servers => generated 406 bytes in 917 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 22 11:24:20.516422 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-4cf70b08-f916-4023-a967-eda2a5f5aadf tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:24:20.517273 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-4cf70b08-f916-4023-a967-eda2a5f5aadf tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] [instance: 03c80c2f-d64d-4b77-86f6-81f65e6752aa] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:24:20.573970 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-4cf70b08-f916-4023-a967-eda2a5f5aadf tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a299663b56b411b9fc910ddf47103e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d58bceb8414b02a1bbaec0db07d85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:24:20.580817 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-4cf70b08-f916-4023-a967-eda2a5f5aadf tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] 10.222.0.20 "GET /compute/v2.1/servers/03c80c2f-d64d-4b77-86f6-81f65e6752aa" status: 200 len: 1094 microversion: 2.1 time: 0.068490 Jul 22 11:24:20.581399 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 549/1077] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:24:20 2022] GET /compute/v2.1/servers/03c80c2f-d64d-4b77-86f6-81f65e6752aa => generated 1094 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:24:21.283811 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-d51fc22c-6b92-4a6e-ac24-73435ad93388 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:24:21.284392 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-d51fc22c-6b92-4a6e-ac24-73435ad93388 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] [instance: 3e342bc0-ddb4-4b26-9d31-04210b39c81c] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:24:21.290540 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-d51fc22c-6b92-4a6e-ac24-73435ad93388 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:21.290985 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-d51fc22c-6b92-4a6e-ac24-73435ad93388 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:21.291791 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-d51fc22c-6b92-4a6e-ac24-73435ad93388 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:21.292742 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-d51fc22c-6b92-4a6e-ac24-73435ad93388 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:21.445875 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-94eea025-e868-4179-9802-72c56a9b68dd tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:24:21.446477 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-94eea025-e868-4179-9802-72c56a9b68dd tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] [instance: 9b7a2a09-12e8-478a-8c51-945180dde6c4] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:24:21.453157 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-94eea025-e868-4179-9802-72c56a9b68dd tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:21.453942 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-94eea025-e868-4179-9802-72c56a9b68dd tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:21.454800 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-94eea025-e868-4179-9802-72c56a9b68dd tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:21.455441 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-94eea025-e868-4179-9802-72c56a9b68dd tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:21.481152 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell0:SELECT=2 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:24:21.495145 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-d51fc22c-6b92-4a6e-ac24-73435ad93388 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af2fb64a6c4a4ea660196aa90a9c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd084bf56f7894fb98a46d7e2cbb34157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:24:21.504364 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-d51fc22c-6b92-4a6e-ac24-73435ad93388 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] 10.222.0.20 "GET /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c" status: 200 len: 1261 microversion: 2.1 time: 0.225196 Jul 22 11:24:21.505013 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 529/1078] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:24:21 2022] GET /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c => generated 1261 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:24:21.605496 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-7c9ae118-dac1-4760-bb84-6167fe6d5774 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:24:21.606119 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-7c9ae118-dac1-4760-bb84-6167fe6d5774 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] [instance: 03c80c2f-d64d-4b77-86f6-81f65e6752aa] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:24:21.614124 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-94eea025-e868-4179-9802-72c56a9b68dd tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00ab892a9233421886b849b879bd8a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f756b95ab7da4271a50fa3b1a5276eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:24:21.618823 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-7c9ae118-dac1-4760-bb84-6167fe6d5774 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:21.619456 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-7c9ae118-dac1-4760-bb84-6167fe6d5774 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:21.621125 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-7c9ae118-dac1-4760-bb84-6167fe6d5774 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:21.621667 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-7c9ae118-dac1-4760-bb84-6167fe6d5774 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:21.625037 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-94eea025-e868-4179-9802-72c56a9b68dd tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] 10.222.0.20 "GET /compute/v2.1/servers/9b7a2a09-12e8-478a-8c51-945180dde6c4" status: 200 len: 1319 microversion: 2.1 time: 0.183026 Jul 22 11:24:21.626119 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 550/1079] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:24:21 2022] GET /compute/v2.1/servers/9b7a2a09-12e8-478a-8c51-945180dde6c4 => generated 1319 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:24:21.722843 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-7c9ae118-dac1-4760-bb84-6167fe6d5774 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a299663b56b411b9fc910ddf47103e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d58bceb8414b02a1bbaec0db07d85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:24:21.726820 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG dbcounter [-] [117884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:24:21.731983 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-7c9ae118-dac1-4760-bb84-6167fe6d5774 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] 10.222.0.20 "GET /compute/v2.1/servers/03c80c2f-d64d-4b77-86f6-81f65e6752aa" status: 200 len: 1210 microversion: 2.1 time: 0.133712 Jul 22 11:24:21.732607 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 530/1080] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:24:21 2022] GET /compute/v2.1/servers/03c80c2f-d64d-4b77-86f6-81f65e6752aa => generated 1210 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:24:22.222104 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-6cd98421-eaa4-43e7-b554-f7776bae67b6 req-9b21684e-09f1-45f5-9055-2a2b02693fcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b7a2a09-12e8-478a-8c51-945180dde6c4", "name": "network-vif-plugged", "status": "completed", "tag": "4956a75d-dbdd-40c1-8cc6-d93b31e25c30"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:24:22.231599 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-6cd98421-eaa4-43e7-b554-f7776bae67b6 req-9b21684e-09f1-45f5-9055-2a2b02693fcb service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:22.232044 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-6cd98421-eaa4-43e7-b554-f7776bae67b6 req-9b21684e-09f1-45f5-9055-2a2b02693fcb service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:22.244754 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-6cd98421-eaa4-43e7-b554-f7776bae67b6 req-9b21684e-09f1-45f5-9055-2a2b02693fcb service nova] Creating event network-vif-plugged:4956a75d-dbdd-40c1-8cc6-d93b31e25c30 for instance 9b7a2a09-12e8-478a-8c51-945180dde6c4 on hv-cinder-84890 Jul 22 11:24:22.249640 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-6cd98421-eaa4-43e7-b554-f7776bae67b6 req-9b21684e-09f1-45f5-9055-2a2b02693fcb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032626 Jul 22 11:24:22.250399 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 551/1081] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:24:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:24:22.526029 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-93e9c5d2-461c-41d8-b3d3-92e1efc0f03e tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:24:22.527331 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-93e9c5d2-461c-41d8-b3d3-92e1efc0f03e tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] [instance: 3e342bc0-ddb4-4b26-9d31-04210b39c81c] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:24:22.547116 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-93e9c5d2-461c-41d8-b3d3-92e1efc0f03e tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:22.547596 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-93e9c5d2-461c-41d8-b3d3-92e1efc0f03e tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:22.548596 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-93e9c5d2-461c-41d8-b3d3-92e1efc0f03e tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:22.549037 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-93e9c5d2-461c-41d8-b3d3-92e1efc0f03e tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:22.643373 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-b183c951-3c30-4216-a315-fded1f49ce9a tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:24:22.644073 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-b183c951-3c30-4216-a315-fded1f49ce9a tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] [instance: 9b7a2a09-12e8-478a-8c51-945180dde6c4] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:24:22.650923 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b183c951-3c30-4216-a315-fded1f49ce9a tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:22.651401 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b183c951-3c30-4216-a315-fded1f49ce9a tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:22.652201 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b183c951-3c30-4216-a315-fded1f49ce9a tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:22.652630 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b183c951-3c30-4216-a315-fded1f49ce9a tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:22.671349 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=100 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:24:22.690580 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-93e9c5d2-461c-41d8-b3d3-92e1efc0f03e tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af2fb64a6c4a4ea660196aa90a9c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd084bf56f7894fb98a46d7e2cbb34157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:24:22.705319 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-93e9c5d2-461c-41d8-b3d3-92e1efc0f03e tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] 10.222.0.20 "GET /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c" status: 200 len: 1261 microversion: 2.1 time: 0.185601 Jul 22 11:24:22.709489 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 531/1082] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:24:22 2022] GET /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c => generated 1261 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:24:22.750001 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-6c3272a9-fb19-4222-b48e-308bf085b952 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:24:22.750619 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-6c3272a9-fb19-4222-b48e-308bf085b952 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] [instance: 03c80c2f-d64d-4b77-86f6-81f65e6752aa] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:24:22.757360 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-6c3272a9-fb19-4222-b48e-308bf085b952 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:22.757819 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-6c3272a9-fb19-4222-b48e-308bf085b952 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:22.758604 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-6c3272a9-fb19-4222-b48e-308bf085b952 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:22.759040 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-6c3272a9-fb19-4222-b48e-308bf085b952 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:22.811699 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-b183c951-3c30-4216-a315-fded1f49ce9a tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00ab892a9233421886b849b879bd8a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f756b95ab7da4271a50fa3b1a5276eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:24:22.819607 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-b183c951-3c30-4216-a315-fded1f49ce9a tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] 10.222.0.20 "GET /compute/v2.1/servers/9b7a2a09-12e8-478a-8c51-945180dde6c4" status: 200 len: 1319 microversion: 2.1 time: 0.180777 Jul 22 11:24:22.820386 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 552/1083] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:24:22 2022] GET /compute/v2.1/servers/9b7a2a09-12e8-478a-8c51-945180dde6c4 => generated 1319 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:24:23.006941 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-6c3272a9-fb19-4222-b48e-308bf085b952 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a299663b56b411b9fc910ddf47103e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d58bceb8414b02a1bbaec0db07d85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:24:23.016282 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-6c3272a9-fb19-4222-b48e-308bf085b952 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] 10.222.0.20 "GET /compute/v2.1/servers/03c80c2f-d64d-4b77-86f6-81f65e6752aa" status: 200 len: 1266 microversion: 2.1 time: 0.270393 Jul 22 11:24:23.026255 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 532/1084] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:24:22 2022] GET /compute/v2.1/servers/03c80c2f-d64d-4b77-86f6-81f65e6752aa => generated 1266 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:24:23.460148 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-4b285333-bb8a-48d5-bddb-1bcf545c94ef req-32b25780-0d66-4f38-84f8-da77aed3a18b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03c80c2f-d64d-4b77-86f6-81f65e6752aa", "tag": "546116d2-e38d-4e95-afb2-bdaec2cf68f5"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:24:23.470209 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-4b285333-bb8a-48d5-bddb-1bcf545c94ef req-32b25780-0d66-4f38-84f8-da77aed3a18b service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:23.470732 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-4b285333-bb8a-48d5-bddb-1bcf545c94ef req-32b25780-0d66-4f38-84f8-da77aed3a18b service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:23.486695 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-4b285333-bb8a-48d5-bddb-1bcf545c94ef req-32b25780-0d66-4f38-84f8-da77aed3a18b service nova] Creating event network-changed:546116d2-e38d-4e95-afb2-bdaec2cf68f5 for instance 03c80c2f-d64d-4b77-86f6-81f65e6752aa on hv-cinder-84890 Jul 22 11:24:23.492691 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-4b285333-bb8a-48d5-bddb-1bcf545c94ef req-32b25780-0d66-4f38-84f8-da77aed3a18b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037821 Jul 22 11:24:23.493847 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 553/1085] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:24:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 22 11:24:23.725638 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-55372896-1ef7-4802-9bc4-36dd2c183dbd tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:24:23.726247 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-55372896-1ef7-4802-9bc4-36dd2c183dbd tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] [instance: 3e342bc0-ddb4-4b26-9d31-04210b39c81c] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:24:23.733123 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-55372896-1ef7-4802-9bc4-36dd2c183dbd tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:23.733575 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-55372896-1ef7-4802-9bc4-36dd2c183dbd tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:23.734369 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-55372896-1ef7-4802-9bc4-36dd2c183dbd tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:23.734369 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-55372896-1ef7-4802-9bc4-36dd2c183dbd tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:23.837161 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-acc6421b-613c-4031-a98f-e607969580b4 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:24:23.838063 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-acc6421b-613c-4031-a98f-e607969580b4 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] [instance: 9b7a2a09-12e8-478a-8c51-945180dde6c4] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:24:23.848912 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-acc6421b-613c-4031-a98f-e607969580b4 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:23.849711 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-acc6421b-613c-4031-a98f-e607969580b4 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:23.851393 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-acc6421b-613c-4031-a98f-e607969580b4 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:23.852341 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-acc6421b-613c-4031-a98f-e607969580b4 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:23.877156 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-55372896-1ef7-4802-9bc4-36dd2c183dbd tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af2fb64a6c4a4ea660196aa90a9c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd084bf56f7894fb98a46d7e2cbb34157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:24:23.884905 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-55372896-1ef7-4802-9bc4-36dd2c183dbd tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] 10.222.0.20 "GET /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c" status: 200 len: 1261 microversion: 2.1 time: 0.163148 Jul 22 11:24:23.885485 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 533/1086] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:24:23 2022] GET /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c => generated 1261 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:24:24.015044 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-acc6421b-613c-4031-a98f-e607969580b4 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00ab892a9233421886b849b879bd8a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f756b95ab7da4271a50fa3b1a5276eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:24:24.023646 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-acc6421b-613c-4031-a98f-e607969580b4 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] 10.222.0.20 "GET /compute/v2.1/servers/9b7a2a09-12e8-478a-8c51-945180dde6c4" status: 200 len: 1508 microversion: 2.1 time: 0.191108 Jul 22 11:24:24.024753 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 554/1087] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:24:23 2022] GET /compute/v2.1/servers/9b7a2a09-12e8-478a-8c51-945180dde6c4 => generated 1508 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:24:24.034469 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-b79b137b-7fd1-4785-ac0b-ba9a1b8948b8 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:24:24.035519 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-b79b137b-7fd1-4785-ac0b-ba9a1b8948b8 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] [instance: 03c80c2f-d64d-4b77-86f6-81f65e6752aa] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:24:24.040505 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-33b420e8-2b03-4dbd-a089-b89ed46e530f tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3a67abed-00fd-4d74-89a6-7389161184e8", "device": "/dev/sdb"}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:24:24.041718 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-33b420e8-2b03-4dbd-a089-b89ed46e530f tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] [instance: 9b7a2a09-12e8-478a-8c51-945180dde6c4] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:24:24.041885 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-b79b137b-7fd1-4785-ac0b-ba9a1b8948b8 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:24.042374 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-b79b137b-7fd1-4785-ac0b-ba9a1b8948b8 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:24.043215 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-b79b137b-7fd1-4785-ac0b-ba9a1b8948b8 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:24.043855 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-b79b137b-7fd1-4785-ac0b-ba9a1b8948b8 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:24.048349 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-33b420e8-2b03-4dbd-a089-b89ed46e530f tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:24.048898 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-33b420e8-2b03-4dbd-a089-b89ed46e530f tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:24.049765 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-33b420e8-2b03-4dbd-a089-b89ed46e530f tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:24.050298 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-33b420e8-2b03-4dbd-a089-b89ed46e530f tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:24.263013 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-b79b137b-7fd1-4785-ac0b-ba9a1b8948b8 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a299663b56b411b9fc910ddf47103e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d58bceb8414b02a1bbaec0db07d85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:24:24.273451 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-b79b137b-7fd1-4785-ac0b-ba9a1b8948b8 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] 10.222.0.20 "GET /compute/v2.1/servers/03c80c2f-d64d-4b77-86f6-81f65e6752aa" status: 200 len: 1266 microversion: 2.1 time: 0.243208 Jul 22 11:24:24.274173 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 534/1088] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:24:24 2022] GET /compute/v2.1/servers/03c80c2f-d64d-4b77-86f6-81f65e6752aa => generated 1266 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:24:24.310494 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-33b420e8-2b03-4dbd-a089-b89ed46e530f tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] 10.222.0.20 "POST /compute/v2.1/servers/9b7a2a09-12e8-478a-8c51-945180dde6c4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.273689 Jul 22 11:24:24.311102 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 555/1089] 10.222.0.20 () {60 vars in 1322 bytes} [Fri Jul 22 11:24:24 2022] POST /compute/v2.1/servers/9b7a2a09-12e8-478a-8c51-945180dde6c4/os-volume_attachments => generated 194 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:24:24.902539 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-8a0cc96a-27d6-48b4-9ac3-e71057cee7db tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:24:24.903177 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-8a0cc96a-27d6-48b4-9ac3-e71057cee7db tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] [instance: 3e342bc0-ddb4-4b26-9d31-04210b39c81c] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:24:24.910351 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-8a0cc96a-27d6-48b4-9ac3-e71057cee7db tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:24.910802 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-8a0cc96a-27d6-48b4-9ac3-e71057cee7db tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:24.911597 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-8a0cc96a-27d6-48b4-9ac3-e71057cee7db tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:24.912030 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-8a0cc96a-27d6-48b4-9ac3-e71057cee7db tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:25.153195 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-8a0cc96a-27d6-48b4-9ac3-e71057cee7db tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af2fb64a6c4a4ea660196aa90a9c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd084bf56f7894fb98a46d7e2cbb34157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:24:25.162002 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-8a0cc96a-27d6-48b4-9ac3-e71057cee7db tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] 10.222.0.20 "GET /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c" status: 200 len: 1261 microversion: 2.1 time: 0.263189 Jul 22 11:24:25.162002 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 535/1090] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:24:24 2022] GET /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c => generated 1261 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:24:25.291314 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-89f7576a-6b22-4f47-b710-2ca4f4420805 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:24:25.291975 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-89f7576a-6b22-4f47-b710-2ca4f4420805 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] [instance: 03c80c2f-d64d-4b77-86f6-81f65e6752aa] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:24:25.298805 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-89f7576a-6b22-4f47-b710-2ca4f4420805 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:25.299274 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-89f7576a-6b22-4f47-b710-2ca4f4420805 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:25.300068 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-89f7576a-6b22-4f47-b710-2ca4f4420805 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:25.300548 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-89f7576a-6b22-4f47-b710-2ca4f4420805 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:25.615403 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-89f7576a-6b22-4f47-b710-2ca4f4420805 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a299663b56b411b9fc910ddf47103e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d58bceb8414b02a1bbaec0db07d85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:24:25.623919 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-89f7576a-6b22-4f47-b710-2ca4f4420805 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] 10.222.0.20 "GET /compute/v2.1/servers/03c80c2f-d64d-4b77-86f6-81f65e6752aa" status: 200 len: 1266 microversion: 2.1 time: 0.337523 Jul 22 11:24:25.624520 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 556/1091] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:24:25 2022] GET /compute/v2.1/servers/03c80c2f-d64d-4b77-86f6-81f65e6752aa => generated 1266 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:24:26.177948 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-c3a5e7ae-35d9-4198-b5a3-45ba7c6c3f5c tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:24:26.179193 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-c3a5e7ae-35d9-4198-b5a3-45ba7c6c3f5c tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] [instance: 3e342bc0-ddb4-4b26-9d31-04210b39c81c] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:24:26.185936 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c3a5e7ae-35d9-4198-b5a3-45ba7c6c3f5c tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:26.186385 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c3a5e7ae-35d9-4198-b5a3-45ba7c6c3f5c tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:26.187168 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c3a5e7ae-35d9-4198-b5a3-45ba7c6c3f5c tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:26.187628 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c3a5e7ae-35d9-4198-b5a3-45ba7c6c3f5c tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:26.330424 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-c3a5e7ae-35d9-4198-b5a3-45ba7c6c3f5c tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af2fb64a6c4a4ea660196aa90a9c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd084bf56f7894fb98a46d7e2cbb34157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:24:26.343056 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-c3a5e7ae-35d9-4198-b5a3-45ba7c6c3f5c tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] 10.222.0.20 "GET /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c" status: 200 len: 1261 microversion: 2.1 time: 0.168916 Jul 22 11:24:26.343692 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 536/1092] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:24:26 2022] GET /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c => generated 1261 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:24:26.641398 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-d977794a-5f14-4eeb-be41-ddbf90fc13e8 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:24:26.642374 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-d977794a-5f14-4eeb-be41-ddbf90fc13e8 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] [instance: 03c80c2f-d64d-4b77-86f6-81f65e6752aa] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:24:26.649203 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d977794a-5f14-4eeb-be41-ddbf90fc13e8 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:26.649717 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d977794a-5f14-4eeb-be41-ddbf90fc13e8 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:26.650482 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d977794a-5f14-4eeb-be41-ddbf90fc13e8 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:26.650908 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d977794a-5f14-4eeb-be41-ddbf90fc13e8 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:26.788789 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-d977794a-5f14-4eeb-be41-ddbf90fc13e8 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a299663b56b411b9fc910ddf47103e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d58bceb8414b02a1bbaec0db07d85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:24:26.796452 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-d977794a-5f14-4eeb-be41-ddbf90fc13e8 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] 10.222.0.20 "GET /compute/v2.1/servers/03c80c2f-d64d-4b77-86f6-81f65e6752aa" status: 200 len: 1266 microversion: 2.1 time: 0.158901 Jul 22 11:24:26.797028 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 557/1093] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:24:26 2022] GET /compute/v2.1/servers/03c80c2f-d64d-4b77-86f6-81f65e6752aa => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:24:27.361127 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-6730c9d7-05a2-4810-9ddf-9cdf6f4b0ace tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:24:27.361751 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-6730c9d7-05a2-4810-9ddf-9cdf6f4b0ace tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] [instance: 3e342bc0-ddb4-4b26-9d31-04210b39c81c] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:24:27.368002 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-6730c9d7-05a2-4810-9ddf-9cdf6f4b0ace tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:27.368444 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-6730c9d7-05a2-4810-9ddf-9cdf6f4b0ace tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:27.369199 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-6730c9d7-05a2-4810-9ddf-9cdf6f4b0ace tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:27.369635 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-6730c9d7-05a2-4810-9ddf-9cdf6f4b0ace tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:27.503596 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-6730c9d7-05a2-4810-9ddf-9cdf6f4b0ace tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af2fb64a6c4a4ea660196aa90a9c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd084bf56f7894fb98a46d7e2cbb34157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:24:27.510889 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-6730c9d7-05a2-4810-9ddf-9cdf6f4b0ace tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] 10.222.0.20 "GET /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c" status: 200 len: 1261 microversion: 2.1 time: 0.154010 Jul 22 11:24:27.511473 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 537/1094] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:24:27 2022] GET /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:24:27.812657 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-2cb95ea4-fcb4-4f91-9ee3-30bb8577648b tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:24:27.813272 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-2cb95ea4-fcb4-4f91-9ee3-30bb8577648b tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] [instance: 03c80c2f-d64d-4b77-86f6-81f65e6752aa] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:24:27.819747 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2cb95ea4-fcb4-4f91-9ee3-30bb8577648b tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:27.820197 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2cb95ea4-fcb4-4f91-9ee3-30bb8577648b tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:27.820966 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2cb95ea4-fcb4-4f91-9ee3-30bb8577648b tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:27.821403 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2cb95ea4-fcb4-4f91-9ee3-30bb8577648b tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:27.951876 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-2cb95ea4-fcb4-4f91-9ee3-30bb8577648b tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a299663b56b411b9fc910ddf47103e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d58bceb8414b02a1bbaec0db07d85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:24:27.959324 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-2cb95ea4-fcb4-4f91-9ee3-30bb8577648b tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] 10.222.0.20 "GET /compute/v2.1/servers/03c80c2f-d64d-4b77-86f6-81f65e6752aa" status: 200 len: 1266 microversion: 2.1 time: 0.150528 Jul 22 11:24:27.959897 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 558/1095] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:24:27 2022] GET /compute/v2.1/servers/03c80c2f-d64d-4b77-86f6-81f65e6752aa => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:24:28.145694 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [req-6848760a-9852-4d40-ae49-da471aeb27b7 req-7807f675-cda2-4812-934c-9cc316952df3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e342bc0-ddb4-4b26-9d31-04210b39c81c", "name": "network-vif-plugged", "status": "completed", "tag": "05eda950-e6f4-4f38-86a7-bf112af47c3b"}]} {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:24:28.155192 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-6848760a-9852-4d40-ae49-da471aeb27b7 req-7807f675-cda2-4812-934c-9cc316952df3 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:28.155853 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-6848760a-9852-4d40-ae49-da471aeb27b7 req-7807f675-cda2-4812-934c-9cc316952df3 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:28.169370 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.compute.server_external_events [req-6848760a-9852-4d40-ae49-da471aeb27b7 req-7807f675-cda2-4812-934c-9cc316952df3 service nova] Creating event network-vif-plugged:05eda950-e6f4-4f38-86a7-bf112af47c3b for instance 3e342bc0-ddb4-4b26-9d31-04210b39c81c on hv-cinder-84890 Jul 22 11:24:28.174291 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [req-6848760a-9852-4d40-ae49-da471aeb27b7 req-7807f675-cda2-4812-934c-9cc316952df3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032404 Jul 22 11:24:28.174888 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 538/1096] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:24:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:24:28.527046 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-899c6ac3-7a6f-4690-af12-94c76f2b2ca8 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:24:28.527848 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-899c6ac3-7a6f-4690-af12-94c76f2b2ca8 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] [instance: 3e342bc0-ddb4-4b26-9d31-04210b39c81c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:24:28.534295 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-899c6ac3-7a6f-4690-af12-94c76f2b2ca8 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:28.534739 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-899c6ac3-7a6f-4690-af12-94c76f2b2ca8 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:28.535544 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-899c6ac3-7a6f-4690-af12-94c76f2b2ca8 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:28.535979 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-899c6ac3-7a6f-4690-af12-94c76f2b2ca8 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:28.687953 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-899c6ac3-7a6f-4690-af12-94c76f2b2ca8 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af2fb64a6c4a4ea660196aa90a9c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd084bf56f7894fb98a46d7e2cbb34157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:24:28.695508 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-899c6ac3-7a6f-4690-af12-94c76f2b2ca8 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] 10.222.0.20 "GET /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c" status: 200 len: 1261 microversion: 2.1 time: 0.172588 Jul 22 11:24:28.696082 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 559/1097] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:24:28 2022] GET /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c => generated 1261 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:24:28.977680 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-fd93143e-fea4-41c3-9bb7-7114cbfe5484 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:24:28.978381 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-fd93143e-fea4-41c3-9bb7-7114cbfe5484 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] [instance: 03c80c2f-d64d-4b77-86f6-81f65e6752aa] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:24:28.985160 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-fd93143e-fea4-41c3-9bb7-7114cbfe5484 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:28.985607 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-fd93143e-fea4-41c3-9bb7-7114cbfe5484 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:28.986375 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-fd93143e-fea4-41c3-9bb7-7114cbfe5484 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:28.986812 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-fd93143e-fea4-41c3-9bb7-7114cbfe5484 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:29.135479 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-fd93143e-fea4-41c3-9bb7-7114cbfe5484 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a299663b56b411b9fc910ddf47103e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d58bceb8414b02a1bbaec0db07d85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:24:29.143233 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-fd93143e-fea4-41c3-9bb7-7114cbfe5484 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] 10.222.0.20 "GET /compute/v2.1/servers/03c80c2f-d64d-4b77-86f6-81f65e6752aa" status: 200 len: 1266 microversion: 2.1 time: 0.170344 Jul 22 11:24:29.143848 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 539/1098] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:24:28 2022] GET /compute/v2.1/servers/03c80c2f-d64d-4b77-86f6-81f65e6752aa => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:24:29.712897 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-60f76d9b-b305-4fb2-9424-cb77c451c0b8 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:24:29.713510 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-60f76d9b-b305-4fb2-9424-cb77c451c0b8 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] [instance: 3e342bc0-ddb4-4b26-9d31-04210b39c81c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:24:29.720726 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-60f76d9b-b305-4fb2-9424-cb77c451c0b8 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:29.721181 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-60f76d9b-b305-4fb2-9424-cb77c451c0b8 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:29.721973 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-60f76d9b-b305-4fb2-9424-cb77c451c0b8 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:29.722409 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-60f76d9b-b305-4fb2-9424-cb77c451c0b8 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:29.865663 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-60f76d9b-b305-4fb2-9424-cb77c451c0b8 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af2fb64a6c4a4ea660196aa90a9c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd084bf56f7894fb98a46d7e2cbb34157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:24:29.873471 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-60f76d9b-b305-4fb2-9424-cb77c451c0b8 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] 10.222.0.20 "GET /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c" status: 200 len: 1445 microversion: 2.1 time: 0.164451 Jul 22 11:24:29.874048 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 560/1099] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:24:29 2022] GET /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c => generated 1445 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:24:29.889793 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-b9d5395e-20c4-48ee-9290-3e3d2b64635f tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:24:29.890393 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-b9d5395e-20c4-48ee-9290-3e3d2b64635f tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] [instance: 3e342bc0-ddb4-4b26-9d31-04210b39c81c] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:24:29.896530 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-b9d5395e-20c4-48ee-9290-3e3d2b64635f tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:29.896968 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-b9d5395e-20c4-48ee-9290-3e3d2b64635f tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:29.897729 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-b9d5395e-20c4-48ee-9290-3e3d2b64635f tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:29.898151 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-b9d5395e-20c4-48ee-9290-3e3d2b64635f tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:30.087357 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-b9d5395e-20c4-48ee-9290-3e3d2b64635f tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af2fb64a6c4a4ea660196aa90a9c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd084bf56f7894fb98a46d7e2cbb34157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:24:30.095005 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-b9d5395e-20c4-48ee-9290-3e3d2b64635f tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] 10.222.0.20 "GET /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c" status: 200 len: 1445 microversion: 2.1 time: 0.209526 Jul 22 11:24:30.095615 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 540/1100] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:24:29 2022] GET /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c => generated 1445 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:24:30.160473 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-4bee59c2-69e4-49c1-9094-3d47db36527a tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:24:30.161079 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-4bee59c2-69e4-49c1-9094-3d47db36527a tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] [instance: 03c80c2f-d64d-4b77-86f6-81f65e6752aa] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:24:30.169376 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4bee59c2-69e4-49c1-9094-3d47db36527a tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:30.169939 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4bee59c2-69e4-49c1-9094-3d47db36527a tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:30.170842 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4bee59c2-69e4-49c1-9094-3d47db36527a tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:30.171306 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4bee59c2-69e4-49c1-9094-3d47db36527a tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:30.324778 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-4bee59c2-69e4-49c1-9094-3d47db36527a tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a299663b56b411b9fc910ddf47103e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d58bceb8414b02a1bbaec0db07d85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:24:30.335765 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-4bee59c2-69e4-49c1-9094-3d47db36527a tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] 10.222.0.20 "GET /compute/v2.1/servers/03c80c2f-d64d-4b77-86f6-81f65e6752aa" status: 200 len: 1266 microversion: 2.1 time: 0.179025 Jul 22 11:24:30.336363 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 561/1101] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:24:30 2022] GET /compute/v2.1/servers/03c80c2f-d64d-4b77-86f6-81f65e6752aa => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:24:31.360952 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-3398596f-8e4e-43fd-917f-25d80afe079c tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:24:31.361752 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-3398596f-8e4e-43fd-917f-25d80afe079c tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] [instance: 03c80c2f-d64d-4b77-86f6-81f65e6752aa] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:24:31.364001 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG dbcounter [-] [117884] Writing DB stats nova_cell0:SELECT=2 {{(pid=117884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:24:31.365308 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG dbcounter [-] [117884] Writing DB stats nova_cell0:SELECT=14 {{(pid=117884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:24:31.371941 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-3398596f-8e4e-43fd-917f-25d80afe079c tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:31.372918 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-3398596f-8e4e-43fd-917f-25d80afe079c tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:31.373508 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-3398596f-8e4e-43fd-917f-25d80afe079c tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:31.373950 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-3398596f-8e4e-43fd-917f-25d80afe079c tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:31.611058 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-3398596f-8e4e-43fd-917f-25d80afe079c tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a299663b56b411b9fc910ddf47103e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d58bceb8414b02a1bbaec0db07d85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:24:31.619543 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-3398596f-8e4e-43fd-917f-25d80afe079c tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] 10.222.0.20 "GET /compute/v2.1/servers/03c80c2f-d64d-4b77-86f6-81f65e6752aa" status: 200 len: 1266 microversion: 2.1 time: 0.262811 Jul 22 11:24:31.620139 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 541/1102] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:24:31 2022] GET /compute/v2.1/servers/03c80c2f-d64d-4b77-86f6-81f65e6752aa => generated 1266 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:24:32.027164 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-ec597ddf-d79d-4a58-ae19-f19bd473d1c2 req-e1df7a45-3626-4ddf-a063-bdc29ebf45b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e342bc0-ddb4-4b26-9d31-04210b39c81c", "tag": "05eda950-e6f4-4f38-86a7-bf112af47c3b"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:24:32.032129 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell0:SELECT=10 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:24:32.037745 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-ec597ddf-d79d-4a58-ae19-f19bd473d1c2 req-e1df7a45-3626-4ddf-a063-bdc29ebf45b3 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:32.038320 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-ec597ddf-d79d-4a58-ae19-f19bd473d1c2 req-e1df7a45-3626-4ddf-a063-bdc29ebf45b3 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:32.050618 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-ec597ddf-d79d-4a58-ae19-f19bd473d1c2 req-e1df7a45-3626-4ddf-a063-bdc29ebf45b3 service nova] Creating event network-changed:05eda950-e6f4-4f38-86a7-bf112af47c3b for instance 3e342bc0-ddb4-4b26-9d31-04210b39c81c on hv-cinder-84890 Jul 22 11:24:32.059430 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-ec597ddf-d79d-4a58-ae19-f19bd473d1c2 req-e1df7a45-3626-4ddf-a063-bdc29ebf45b3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032429 Jul 22 11:24:32.060429 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 562/1103] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:24:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:24:32.641545 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-9c1a5f29-db8d-40ef-80e6-eb6cfcc97b28 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:24:32.643304 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-9c1a5f29-db8d-40ef-80e6-eb6cfcc97b28 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] [instance: 03c80c2f-d64d-4b77-86f6-81f65e6752aa] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:24:32.654423 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-9c1a5f29-db8d-40ef-80e6-eb6cfcc97b28 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:32.655333 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-9c1a5f29-db8d-40ef-80e6-eb6cfcc97b28 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:32.656371 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-9c1a5f29-db8d-40ef-80e6-eb6cfcc97b28 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:32.656986 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-9c1a5f29-db8d-40ef-80e6-eb6cfcc97b28 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:32.803552 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-9c1a5f29-db8d-40ef-80e6-eb6cfcc97b28 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a299663b56b411b9fc910ddf47103e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d58bceb8414b02a1bbaec0db07d85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:24:32.814215 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-9c1a5f29-db8d-40ef-80e6-eb6cfcc97b28 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] 10.222.0.20 "GET /compute/v2.1/servers/03c80c2f-d64d-4b77-86f6-81f65e6752aa" status: 200 len: 1266 microversion: 2.1 time: 0.180099 Jul 22 11:24:32.815297 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 542/1104] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:24:32 2022] GET /compute/v2.1/servers/03c80c2f-d64d-4b77-86f6-81f65e6752aa => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:24:33.832978 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-3366d34d-ab97-4868-a613-477862b5ca48 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:24:33.833682 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-3366d34d-ab97-4868-a613-477862b5ca48 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] [instance: 03c80c2f-d64d-4b77-86f6-81f65e6752aa] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:24:33.840626 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3366d34d-ab97-4868-a613-477862b5ca48 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:33.841072 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3366d34d-ab97-4868-a613-477862b5ca48 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:33.841846 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3366d34d-ab97-4868-a613-477862b5ca48 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:33.842287 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3366d34d-ab97-4868-a613-477862b5ca48 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:33.982282 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-3366d34d-ab97-4868-a613-477862b5ca48 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a299663b56b411b9fc910ddf47103e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d58bceb8414b02a1bbaec0db07d85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:24:33.990554 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-3366d34d-ab97-4868-a613-477862b5ca48 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] 10.222.0.20 "GET /compute/v2.1/servers/03c80c2f-d64d-4b77-86f6-81f65e6752aa" status: 200 len: 1266 microversion: 2.1 time: 0.162307 Jul 22 11:24:33.991142 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 563/1105] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:24:33 2022] GET /compute/v2.1/servers/03c80c2f-d64d-4b77-86f6-81f65e6752aa => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:24:34.388870 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [req-ee7f258f-42f6-4d61-af3a-f0f560cdbc20 req-3339204b-ca0c-4bba-85d4-33496c19cbeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03c80c2f-d64d-4b77-86f6-81f65e6752aa", "name": "network-vif-plugged", "status": "completed", "tag": "546116d2-e38d-4e95-afb2-bdaec2cf68f5"}]} {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:24:34.399011 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG dbcounter [-] [117884] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=117884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:24:34.407246 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-ee7f258f-42f6-4d61-af3a-f0f560cdbc20 req-3339204b-ca0c-4bba-85d4-33496c19cbeb service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:34.407713 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-ee7f258f-42f6-4d61-af3a-f0f560cdbc20 req-3339204b-ca0c-4bba-85d4-33496c19cbeb service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:34.421674 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.compute.server_external_events [req-ee7f258f-42f6-4d61-af3a-f0f560cdbc20 req-3339204b-ca0c-4bba-85d4-33496c19cbeb service nova] Creating event network-vif-plugged:546116d2-e38d-4e95-afb2-bdaec2cf68f5 for instance 03c80c2f-d64d-4b77-86f6-81f65e6752aa on hv-cinder-84890 Jul 22 11:24:34.427135 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [req-ee7f258f-42f6-4d61-af3a-f0f560cdbc20 req-3339204b-ca0c-4bba-85d4-33496c19cbeb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045215 Jul 22 11:24:34.427868 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 543/1106] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:24:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:24:35.006973 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-b1f9f586-c290-41fe-909f-cffc1b37514d tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:24:35.007597 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-b1f9f586-c290-41fe-909f-cffc1b37514d tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] [instance: 03c80c2f-d64d-4b77-86f6-81f65e6752aa] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:24:35.014428 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b1f9f586-c290-41fe-909f-cffc1b37514d tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:35.014877 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b1f9f586-c290-41fe-909f-cffc1b37514d tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:35.015801 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b1f9f586-c290-41fe-909f-cffc1b37514d tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:35.016246 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b1f9f586-c290-41fe-909f-cffc1b37514d tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:35.172717 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-b1f9f586-c290-41fe-909f-cffc1b37514d tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a299663b56b411b9fc910ddf47103e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d58bceb8414b02a1bbaec0db07d85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:24:35.180461 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-b1f9f586-c290-41fe-909f-cffc1b37514d tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] 10.222.0.20 "GET /compute/v2.1/servers/03c80c2f-d64d-4b77-86f6-81f65e6752aa" status: 200 len: 1266 microversion: 2.1 time: 0.177342 Jul 22 11:24:35.181182 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 564/1107] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:24:35 2022] GET /compute/v2.1/servers/03c80c2f-d64d-4b77-86f6-81f65e6752aa => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:24:36.201769 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-2eb23aab-eac5-4158-888a-361995862c26 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:24:36.203032 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-2eb23aab-eac5-4158-888a-361995862c26 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] [instance: 03c80c2f-d64d-4b77-86f6-81f65e6752aa] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:24:36.212473 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-2eb23aab-eac5-4158-888a-361995862c26 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:36.213250 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-2eb23aab-eac5-4158-888a-361995862c26 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:36.214596 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-2eb23aab-eac5-4158-888a-361995862c26 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:36.215392 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-2eb23aab-eac5-4158-888a-361995862c26 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:36.401499 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-2eb23aab-eac5-4158-888a-361995862c26 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a299663b56b411b9fc910ddf47103e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d58bceb8414b02a1bbaec0db07d85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:24:36.415152 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-2eb23aab-eac5-4158-888a-361995862c26 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] 10.222.0.20 "GET /compute/v2.1/servers/03c80c2f-d64d-4b77-86f6-81f65e6752aa" status: 200 len: 1266 microversion: 2.1 time: 0.221191 Jul 22 11:24:36.416235 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 544/1108] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:24:36 2022] GET /compute/v2.1/servers/03c80c2f-d64d-4b77-86f6-81f65e6752aa => generated 1266 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:24:37.441690 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-9a37c9d7-7ee1-40df-8d15-97a521330e27 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:24:37.442755 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-9a37c9d7-7ee1-40df-8d15-97a521330e27 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] [instance: 03c80c2f-d64d-4b77-86f6-81f65e6752aa] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:24:37.452294 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9a37c9d7-7ee1-40df-8d15-97a521330e27 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:37.452912 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9a37c9d7-7ee1-40df-8d15-97a521330e27 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:37.453986 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9a37c9d7-7ee1-40df-8d15-97a521330e27 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:37.454507 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9a37c9d7-7ee1-40df-8d15-97a521330e27 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:37.599009 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-9a37c9d7-7ee1-40df-8d15-97a521330e27 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a299663b56b411b9fc910ddf47103e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d58bceb8414b02a1bbaec0db07d85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:24:37.607598 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-9a37c9d7-7ee1-40df-8d15-97a521330e27 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] 10.222.0.20 "GET /compute/v2.1/servers/03c80c2f-d64d-4b77-86f6-81f65e6752aa" status: 200 len: 1266 microversion: 2.1 time: 0.178225 Jul 22 11:24:37.608320 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 565/1109] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:24:37 2022] GET /compute/v2.1/servers/03c80c2f-d64d-4b77-86f6-81f65e6752aa => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:24:38.631485 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-c060ea8d-d919-4f98-9406-7f1198fcc532 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:24:38.635107 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-c060ea8d-d919-4f98-9406-7f1198fcc532 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] [instance: 03c80c2f-d64d-4b77-86f6-81f65e6752aa] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:24:38.639519 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c060ea8d-d919-4f98-9406-7f1198fcc532 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:38.640023 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c060ea8d-d919-4f98-9406-7f1198fcc532 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:38.640753 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c060ea8d-d919-4f98-9406-7f1198fcc532 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:38.641197 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c060ea8d-d919-4f98-9406-7f1198fcc532 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:38.810470 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-c060ea8d-d919-4f98-9406-7f1198fcc532 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a299663b56b411b9fc910ddf47103e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d58bceb8414b02a1bbaec0db07d85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:24:38.818983 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-c060ea8d-d919-4f98-9406-7f1198fcc532 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] 10.222.0.20 "GET /compute/v2.1/servers/03c80c2f-d64d-4b77-86f6-81f65e6752aa" status: 200 len: 1266 microversion: 2.1 time: 0.191633 Jul 22 11:24:38.819603 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 545/1110] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:24:38 2022] GET /compute/v2.1/servers/03c80c2f-d64d-4b77-86f6-81f65e6752aa => generated 1266 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:24:39.838637 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-17168383-9b03-441b-b75f-83202f058ac5 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:24:39.840137 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-17168383-9b03-441b-b75f-83202f058ac5 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] [instance: 03c80c2f-d64d-4b77-86f6-81f65e6752aa] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:24:39.845326 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:24:39.852569 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-17168383-9b03-441b-b75f-83202f058ac5 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:39.853052 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-17168383-9b03-441b-b75f-83202f058ac5 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:39.853829 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-17168383-9b03-441b-b75f-83202f058ac5 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:39.854260 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-17168383-9b03-441b-b75f-83202f058ac5 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:40.012188 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-17168383-9b03-441b-b75f-83202f058ac5 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a299663b56b411b9fc910ddf47103e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d58bceb8414b02a1bbaec0db07d85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:24:40.023853 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-17168383-9b03-441b-b75f-83202f058ac5 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] 10.222.0.20 "GET /compute/v2.1/servers/03c80c2f-d64d-4b77-86f6-81f65e6752aa" status: 200 len: 1266 microversion: 2.1 time: 0.191316 Jul 22 11:24:40.024769 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 566/1111] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:24:39 2022] GET /compute/v2.1/servers/03c80c2f-d64d-4b77-86f6-81f65e6752aa => generated 1266 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:24:41.047568 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-753305cf-c64d-4761-87f8-a32665d05b0e tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:24:41.048223 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-753305cf-c64d-4761-87f8-a32665d05b0e tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] [instance: 03c80c2f-d64d-4b77-86f6-81f65e6752aa] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:24:41.054850 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-753305cf-c64d-4761-87f8-a32665d05b0e tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:41.055343 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-753305cf-c64d-4761-87f8-a32665d05b0e tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:41.056126 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-753305cf-c64d-4761-87f8-a32665d05b0e tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:41.056589 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-753305cf-c64d-4761-87f8-a32665d05b0e tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:41.218757 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-753305cf-c64d-4761-87f8-a32665d05b0e tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a299663b56b411b9fc910ddf47103e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d58bceb8414b02a1bbaec0db07d85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:24:41.229390 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-753305cf-c64d-4761-87f8-a32665d05b0e tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] 10.222.0.20 "GET /compute/v2.1/servers/03c80c2f-d64d-4b77-86f6-81f65e6752aa" status: 200 len: 1454 microversion: 2.1 time: 0.186097 Jul 22 11:24:41.230799 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 546/1112] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:24:41 2022] GET /compute/v2.1/servers/03c80c2f-d64d-4b77-86f6-81f65e6752aa => generated 1454 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:24:41.248734 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-e0c857fe-c598-409c-970f-756190cbad65 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:24:41.249531 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-e0c857fe-c598-409c-970f-756190cbad65 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] [instance: 03c80c2f-d64d-4b77-86f6-81f65e6752aa] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:24:41.256605 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e0c857fe-c598-409c-970f-756190cbad65 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:41.257092 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e0c857fe-c598-409c-970f-756190cbad65 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:41.257862 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e0c857fe-c598-409c-970f-756190cbad65 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:41.258300 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e0c857fe-c598-409c-970f-756190cbad65 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:41.401950 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-e0c857fe-c598-409c-970f-756190cbad65 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a299663b56b411b9fc910ddf47103e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d58bceb8414b02a1bbaec0db07d85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:24:41.410667 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-e0c857fe-c598-409c-970f-756190cbad65 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] 10.222.0.20 "GET /compute/v2.1/servers/03c80c2f-d64d-4b77-86f6-81f65e6752aa" status: 200 len: 1454 microversion: 2.1 time: 0.167954 Jul 22 11:24:41.411247 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 567/1113] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:24:41 2022] GET /compute/v2.1/servers/03c80c2f-d64d-4b77-86f6-81f65e6752aa => generated 1454 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:24:43.574102 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [req-0884abed-53da-4daa-ab6f-0fb7507b92a2 req-2bfa55d8-53f0-4a31-8b42-ab448dc97f92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03c80c2f-d64d-4b77-86f6-81f65e6752aa", "tag": "546116d2-e38d-4e95-afb2-bdaec2cf68f5"}]} {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:24:43.585374 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-0884abed-53da-4daa-ab6f-0fb7507b92a2 req-2bfa55d8-53f0-4a31-8b42-ab448dc97f92 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:43.585823 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-0884abed-53da-4daa-ab6f-0fb7507b92a2 req-2bfa55d8-53f0-4a31-8b42-ab448dc97f92 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:43.597985 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.compute.server_external_events [req-0884abed-53da-4daa-ab6f-0fb7507b92a2 req-2bfa55d8-53f0-4a31-8b42-ab448dc97f92 service nova] Creating event network-changed:546116d2-e38d-4e95-afb2-bdaec2cf68f5 for instance 03c80c2f-d64d-4b77-86f6-81f65e6752aa on hv-cinder-84890 Jul 22 11:24:43.604913 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [req-0884abed-53da-4daa-ab6f-0fb7507b92a2 req-2bfa55d8-53f0-4a31-8b42-ab448dc97f92 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113601 Jul 22 11:24:43.604913 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 547/1114] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:24:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:24:45.012028 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-89bbf0bc-fbd8-4a5e-ad61-c2af12b305bb tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:24:45.013360 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-89bbf0bc-fbd8-4a5e-ad61-c2af12b305bb tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] [instance: 9b7a2a09-12e8-478a-8c51-945180dde6c4] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:24:45.027635 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-89bbf0bc-fbd8-4a5e-ad61-c2af12b305bb tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:45.028085 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-89bbf0bc-fbd8-4a5e-ad61-c2af12b305bb tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:45.028838 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-89bbf0bc-fbd8-4a5e-ad61-c2af12b305bb tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:45.029267 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-89bbf0bc-fbd8-4a5e-ad61-c2af12b305bb tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:45.111795 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.objects.instance [None req-89bbf0bc-fbd8-4a5e-ad61-c2af12b305bb tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lazy-loading 'services' on Instance uuid 9b7a2a09-12e8-478a-8c51-945180dde6c4 {{(pid=117885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 22 11:24:45.115461 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:24:45.194272 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-89bbf0bc-fbd8-4a5e-ad61-c2af12b305bb tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9b7a2a09-12e8-478a-8c51-945180dde6c4/os-volume_attachments/3a67abed-00fd-4d74-89a6-7389161184e8" status: 202 len: 0 microversion: 2.1 time: 0.186540 Jul 22 11:24:45.194891 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 568/1115] 10.222.0.20 () {58 vars in 1415 bytes} [Fri Jul 22 11:24:45 2022] DELETE /compute/v2.1/servers/9b7a2a09-12e8-478a-8c51-945180dde6c4/os-volume_attachments/3a67abed-00fd-4d74-89a6-7389161184e8 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 22 11:24:46.328171 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-09ecb9a2-d1b1-4d63-8072-105ab1cd3c90 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:24:46.328803 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-09ecb9a2-d1b1-4d63-8072-105ab1cd3c90 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] [instance: 9b7a2a09-12e8-478a-8c51-945180dde6c4] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:24:46.335560 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-09ecb9a2-d1b1-4d63-8072-105ab1cd3c90 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:46.336008 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-09ecb9a2-d1b1-4d63-8072-105ab1cd3c90 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:46.336769 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-09ecb9a2-d1b1-4d63-8072-105ab1cd3c90 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:46.337197 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-09ecb9a2-d1b1-4d63-8072-105ab1cd3c90 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:46.363424 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-09ecb9a2-d1b1-4d63-8072-105ab1cd3c90 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] [instance: 9b7a2a09-12e8-478a-8c51-945180dde6c4] Going to try to terminate instance {{(pid=117884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 22 11:24:46.391681 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG dbcounter [-] [117884] Writing DB stats nova_cell1:SELECT=100 {{(pid=117884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:24:46.443610 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-09ecb9a2-d1b1-4d63-8072-105ab1cd3c90 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9b7a2a09-12e8-478a-8c51-945180dde6c4" status: 204 len: 0 microversion: 2.1 time: 0.121164 Jul 22 11:24:46.444585 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 548/1116] 10.222.0.20 () {58 vars in 1238 bytes} [Fri Jul 22 11:24:46 2022] DELETE /compute/v2.1/servers/9b7a2a09-12e8-478a-8c51-945180dde6c4 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 22 11:24:46.458440 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-4a04ce07-8fed-4c4f-9f35-83e6f3856a9e tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:24:46.459387 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-4a04ce07-8fed-4c4f-9f35-83e6f3856a9e tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] [instance: 9b7a2a09-12e8-478a-8c51-945180dde6c4] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:24:46.466748 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4a04ce07-8fed-4c4f-9f35-83e6f3856a9e tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:46.467206 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4a04ce07-8fed-4c4f-9f35-83e6f3856a9e tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:46.468019 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4a04ce07-8fed-4c4f-9f35-83e6f3856a9e tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:46.468457 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4a04ce07-8fed-4c4f-9f35-83e6f3856a9e tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:46.627895 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-4a04ce07-8fed-4c4f-9f35-83e6f3856a9e tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00ab892a9233421886b849b879bd8a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f756b95ab7da4271a50fa3b1a5276eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:24:46.636352 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-4a04ce07-8fed-4c4f-9f35-83e6f3856a9e tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] 10.222.0.20 "GET /compute/v2.1/servers/9b7a2a09-12e8-478a-8c51-945180dde6c4" status: 200 len: 1514 microversion: 2.1 time: 0.185026 Jul 22 11:24:46.636941 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 569/1117] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:24:46 2022] GET /compute/v2.1/servers/9b7a2a09-12e8-478a-8c51-945180dde6c4 => generated 1514 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:24:47.655767 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-af5850bc-af90-42c7-be4f-2e6a7a645854 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:24:47.656467 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-af5850bc-af90-42c7-be4f-2e6a7a645854 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] [instance: 9b7a2a09-12e8-478a-8c51-945180dde6c4] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:24:47.663330 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-af5850bc-af90-42c7-be4f-2e6a7a645854 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:47.663785 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-af5850bc-af90-42c7-be4f-2e6a7a645854 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:47.664568 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-af5850bc-af90-42c7-be4f-2e6a7a645854 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:47.665006 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-af5850bc-af90-42c7-be4f-2e6a7a645854 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:47.812631 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-af5850bc-af90-42c7-be4f-2e6a7a645854 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00ab892a9233421886b849b879bd8a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f756b95ab7da4271a50fa3b1a5276eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:24:47.820392 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-af5850bc-af90-42c7-be4f-2e6a7a645854 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] 10.222.0.20 "GET /compute/v2.1/servers/9b7a2a09-12e8-478a-8c51-945180dde6c4" status: 200 len: 1514 microversion: 2.1 time: 0.170321 Jul 22 11:24:47.820971 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 549/1118] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:24:47 2022] GET /compute/v2.1/servers/9b7a2a09-12e8-478a-8c51-945180dde6c4 => generated 1514 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:24:48.722431 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-b4f3428b-107c-4d44-a218-d66b8cc79605 req-503b59cc-93c6-4289-a440-f7caea39062b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b7a2a09-12e8-478a-8c51-945180dde6c4", "name": "network-vif-deleted", "tag": "4956a75d-dbdd-40c1-8cc6-d93b31e25c30"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:24:48.740081 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-b4f3428b-107c-4d44-a218-d66b8cc79605 req-503b59cc-93c6-4289-a440-f7caea39062b service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:48.740522 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-b4f3428b-107c-4d44-a218-d66b8cc79605 req-503b59cc-93c6-4289-a440-f7caea39062b service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:48.753249 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-b4f3428b-107c-4d44-a218-d66b8cc79605 req-503b59cc-93c6-4289-a440-f7caea39062b service nova] Creating event network-vif-deleted:4956a75d-dbdd-40c1-8cc6-d93b31e25c30 for instance 9b7a2a09-12e8-478a-8c51-945180dde6c4 on hv-cinder-84890 Jul 22 11:24:48.758292 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-b4f3428b-107c-4d44-a218-d66b8cc79605 req-503b59cc-93c6-4289-a440-f7caea39062b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039737 Jul 22 11:24:48.758976 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 570/1119] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:24:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:24:48.838209 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-7265204e-71e8-4c28-9986-3e9cc2dc421c tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:24:48.839368 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-7265204e-71e8-4c28-9986-3e9cc2dc421c tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] [instance: 9b7a2a09-12e8-478a-8c51-945180dde6c4] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:24:48.846212 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-7265204e-71e8-4c28-9986-3e9cc2dc421c tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:48.846648 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-7265204e-71e8-4c28-9986-3e9cc2dc421c tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:48.847465 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-7265204e-71e8-4c28-9986-3e9cc2dc421c tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:48.848252 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-7265204e-71e8-4c28-9986-3e9cc2dc421c tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:48.882957 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-7265204e-71e8-4c28-9986-3e9cc2dc421c tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:48.883424 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-7265204e-71e8-4c28-9986-3e9cc2dc421c tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:48.883877 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.objects.instance [None req-7265204e-71e8-4c28-9986-3e9cc2dc421c tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lazy-loading 'fault' on Instance uuid 9b7a2a09-12e8-478a-8c51-945180dde6c4 {{(pid=117884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 22 11:24:48.928486 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-7265204e-71e8-4c28-9986-3e9cc2dc421c tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00ab892a9233421886b849b879bd8a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f756b95ab7da4271a50fa3b1a5276eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:24:48.939483 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-7265204e-71e8-4c28-9986-3e9cc2dc421c tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] 10.222.0.20 "GET /compute/v2.1/servers/9b7a2a09-12e8-478a-8c51-945180dde6c4" status: 200 len: 1309 microversion: 2.1 time: 0.105204 Jul 22 11:24:48.940062 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 550/1120] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:24:48 2022] GET /compute/v2.1/servers/9b7a2a09-12e8-478a-8c51-945180dde6c4 => generated 1309 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:24:49.966618 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-ad9e11c5-5cf5-4df8-8455-779fc7d9c618 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:24:49.967237 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-ad9e11c5-5cf5-4df8-8455-779fc7d9c618 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] [instance: 9b7a2a09-12e8-478a-8c51-945180dde6c4] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:24:49.973655 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ad9e11c5-5cf5-4df8-8455-779fc7d9c618 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:49.974102 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ad9e11c5-5cf5-4df8-8455-779fc7d9c618 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:49.974849 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ad9e11c5-5cf5-4df8-8455-779fc7d9c618 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:24:49.975301 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ad9e11c5-5cf5-4df8-8455-779fc7d9c618 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:24:49.991295 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.wsgi [None req-ad9e11c5-5cf5-4df8-8455-779fc7d9c618 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] HTTP exception thrown: Instance 9b7a2a09-12e8-478a-8c51-945180dde6c4 could not be found. Jul 22 11:24:49.992917 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-ad9e11c5-5cf5-4df8-8455-779fc7d9c618 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Request method failure captured: Jul 22 11:24:49.992917 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: request: GET /compute/v2.1/servers/9b7a2a09-12e8-478a-8c51-945180dde6c4 HTTP/1.1 Jul 22 11:24:49.992917 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Accept: application/json Jul 22 11:24:49.992917 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Accept-Encoding: identity Jul 22 11:24:49.992917 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Connection: close Jul 22 11:24:49.992917 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Content-Length: 0 Jul 22 11:24:49.992917 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Content-Type: application/json Jul 22 11:24:49.992917 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Host: 10.222.0.20 Jul 22 11:24:49.992917 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Openstack-System-Scope: None Jul 22 11:24:49.992917 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: User-Agent: python-urllib3/1.26.9 Jul 22 11:24:49.992917 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Auth-Token: gAAAAABi2oiGKD6vXJ7-l10lfJIwzQrtxMXMsn-aSU9toSXT7nvYPZvdv0Nmf7LccROJaAyRdaf2LQHNSYIESNkE0rk8XnNst_PDI2iJQ_Me_-EBlcmNGu7dGLB43LM0c97wy5P4abWKOdZ93MSHycA82tMxmzsssvb4jvJxVEqdjzq85A5xmMg Jul 22 11:24:49.992917 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Domain-Id: None Jul 22 11:24:49.992917 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Domain-Name: None Jul 22 11:24:49.992917 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Identity-Status: Confirmed Jul 22 11:24:49.992917 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Is-Admin-Project: True Jul 22 11:24:49.992917 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Project-Domain-Id: default Jul 22 11:24:49.992917 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Project-Domain-Name: Default Jul 22 11:24:49.992917 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Project-Id: f756b95ab7da4271a50fa3b1a5276eea Jul 22 11:24:49.992917 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Project-Name: tempest-VolumesSnapshotTestJSON-822882006 Jul 22 11:24:49.992917 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Role: reader,member Jul 22 11:24:49.992917 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Roles: reader,member Jul 22 11:24:49.998414 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f756b95ab7da4271a50fa3b1a5276eea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f756b95ab7da4271a50fa3b1a5276eea", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f756b95ab7da4271a50fa3b1a5276eea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f756b95ab7da4271a50fa3b1a5276eea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jul 22 11:24:49.998414 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Tenant: tempest-VolumesSnapshotTestJSON-822882006 Jul 22 11:24:49.998414 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Tenant-Id: f756b95ab7da4271a50fa3b1a5276eea Jul 22 11:24:49.998414 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-822882006 Jul 22 11:24:49.998414 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User: tempest-VolumesSnapshotTestJSON-822882006-project Jul 22 11:24:49.998414 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User-Domain-Id: default Jul 22 11:24:49.998414 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User-Domain-Name: Default Jul 22 11:24:49.998414 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User-Id: 00ab892a9233421886b849b879bd8a7e Jul 22 11:24:49.998414 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User-Name: tempest-VolumesSnapshotTestJSON-822882006-project Jul 22 11:24:49.998414 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: method: > Jul 22 11:24:49.998414 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: exception: Instance 9b7a2a09-12e8-478a-8c51-945180dde6c4 could not be found. Jul 22 11:24:49.998414 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: action_args: {'id': '9b7a2a09-12e8-478a-8c51-945180dde6c4'} Jul 22 11:24:49.999444 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 22 11:24:49.999444 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:24:49.999444 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 22 11:24:49.999444 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 22 11:24:49.999444 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 22 11:24:49.999444 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 22 11:24:49.999444 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 22 11:24:49.999444 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 22 11:24:49.999444 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 22 11:24:49.999444 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 22 11:24:49.999444 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b7a2a09-12e8-478a-8c51-945180dde6c4 could not be found. Jul 22 11:24:49.999444 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:24:49.999444 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:24:49.999444 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:24:49.999444 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:24:49.999444 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:24:49.999444 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:24:49.999444 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 22 11:24:49.999444 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 22 11:24:49.999444 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 22 11:24:50.001003 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 22 11:24:50.001003 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 22 11:24:50.001003 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 22 11:24:50.001003 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 22 11:24:50.001003 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 22 11:24:50.001003 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 22 11:24:50.001003 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 22 11:24:50.001003 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b7a2a09-12e8-478a-8c51-945180dde6c4 could not be found. Jul 22 11:24:50.001003 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:24:50.001003 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:24:50.001003 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:24:50.001003 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:24:50.001003 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:24:50.001003 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:24:50.001003 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 22 11:24:50.001003 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 22 11:24:50.001003 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b7a2a09-12e8-478a-8c51-945180dde6c4 could not be found. Jul 22 11:24:50.001003 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:24:50.002395 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-ad9e11c5-5cf5-4df8-8455-779fc7d9c618 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] Returning 404 to user: Instance 9b7a2a09-12e8-478a-8c51-945180dde6c4 could not be found. {{(pid=117885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 22 11:24:50.002395 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-ad9e11c5-5cf5-4df8-8455-779fc7d9c618 tempest-VolumesSnapshotTestJSON-822882006 tempest-VolumesSnapshotTestJSON-822882006-project] 10.222.0.20 "GET /compute/v2.1/servers/9b7a2a09-12e8-478a-8c51-945180dde6c4" status: 404 len: 111 microversion: 2.1 time: 0.032638 Jul 22 11:24:50.002395 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 571/1121] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:24:49 2022] GET /compute/v2.1/servers/9b7a2a09-12e8-478a-8c51-945180dde6c4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 22 11:25:42.647789 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 22 11:25:42.648624 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Fri Jul 22 11:25:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 22 11:26:29.728206 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG dbcounter [-] [117884] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=117884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:26:29.728949 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG dbcounter [-] [117884] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=18,nova_cell1:INSERT=1 {{(pid=117884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:26:29.733502 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-6fae7d2f-42cc-4717-aa93-48a9d2b5e69e tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-383278536", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-600883544", "security_groups": [{"name": "tempest-secgroup-smoke-1266173586"}], "block_device_mapping_v2": [{"uuid": "91f8a9a0-e85d-4c98-a6e6-97daaabdd48d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "050b1084-bd00-4a10-81b9-1276e2d9b4d8"}]}} {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:26:29.844451 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.network.neutron [None req-6fae7d2f-42cc-4717-aa93-48a9d2b5e69e tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] validate_networks() for [('050b1084-bd00-4a10-81b9-1276e2d9b4d8', None, None, None, None, None)] {{(pid=117884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 22 11:26:30.312605 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.virt.hardware [None req-6fae7d2f-42cc-4717-aa93-48a9d2b5e69e tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Flavor limits 0:0:0 {{(pid=117884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 22 11:26:30.313025 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.virt.hardware [None req-6fae7d2f-42cc-4717-aa93-48a9d2b5e69e tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Image limits 0:0:0 {{(pid=117884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 22 11:26:30.313499 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.virt.hardware [None req-6fae7d2f-42cc-4717-aa93-48a9d2b5e69e tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Flavor pref 0:0:0 {{(pid=117884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 22 11:26:30.313906 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.virt.hardware [None req-6fae7d2f-42cc-4717-aa93-48a9d2b5e69e tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Image pref 0:0:0 {{(pid=117884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 22 11:26:30.314368 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.virt.hardware [None req-6fae7d2f-42cc-4717-aa93-48a9d2b5e69e tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 22 11:26:30.323120 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-6fae7d2f-42cc-4717-aa93-48a9d2b5e69e tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:26:30.323594 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-6fae7d2f-42cc-4717-aa93-48a9d2b5e69e tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:26:30.324397 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-6fae7d2f-42cc-4717-aa93-48a9d2b5e69e tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:26:30.324831 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-6fae7d2f-42cc-4717-aa93-48a9d2b5e69e tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:26:30.345075 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.quota [None req-6fae7d2f-42cc-4717-aa93-48a9d2b5e69e tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Getting quotas for project 04d58bceb8414b02a1bbaec0db07d85e. Resources: {'instances', 'cores', 'ram'} {{(pid=117884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 22 11:26:30.348995 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.quota [None req-6fae7d2f-42cc-4717-aa93-48a9d2b5e69e tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Getting quotas for user 1a299663b56b411b9fc910ddf47103e5 and project 04d58bceb8414b02a1bbaec0db07d85e. Resources: {'instances', 'cores', 'ram'} {{(pid=117884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 22 11:26:30.404993 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-6fae7d2f-42cc-4717-aa93-48a9d2b5e69e tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Going to run 1 instances... {{(pid=117884) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 22 11:26:30.407080 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-6fae7d2f-42cc-4717-aa93-48a9d2b5e69e tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] [instance: b2829ff8-193e-4095-aec6-4abfe1c5e678] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='91f8a9a0-e85d-4c98-a6e6-97daaabdd48d',volume_size=None,volume_type=None)] {{(pid=117884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 22 11:26:30.531538 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-6fae7d2f-42cc-4717-aa93-48a9d2b5e69e tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.805184 Jul 22 11:26:30.532199 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 551/1122] 10.222.0.20 () {60 vars in 1146 bytes} [Fri Jul 22 11:26:29 2022] POST /compute/v2.1/servers => generated 406 bytes in 807 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 22 11:26:30.540236 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_api:SELECT=11 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:26:30.541417 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=11,nova_cell1:INSERT=1 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:26:30.546274 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-5c5c3f4c-8203-437a-bf67-8dd10b6205dc tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:26:30.547006 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-5c5c3f4c-8203-437a-bf67-8dd10b6205dc tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] [instance: b2829ff8-193e-4095-aec6-4abfe1c5e678] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:26:30.606339 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-5c5c3f4c-8203-437a-bf67-8dd10b6205dc tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a299663b56b411b9fc910ddf47103e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d58bceb8414b02a1bbaec0db07d85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:26:30.613079 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-5c5c3f4c-8203-437a-bf67-8dd10b6205dc tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] 10.222.0.20 "GET /compute/v2.1/servers/b2829ff8-193e-4095-aec6-4abfe1c5e678" status: 200 len: 1093 microversion: 2.1 time: 0.074751 Jul 22 11:26:30.613650 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 572/1123] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:26:30 2022] GET /compute/v2.1/servers/b2829ff8-193e-4095-aec6-4abfe1c5e678 => generated 1093 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:26:31.631061 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-f993a0b7-a945-4cb2-81ee-1fd8e9417a8c tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:26:31.632371 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-f993a0b7-a945-4cb2-81ee-1fd8e9417a8c tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] [instance: b2829ff8-193e-4095-aec6-4abfe1c5e678] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:26:31.639717 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f993a0b7-a945-4cb2-81ee-1fd8e9417a8c tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:26:31.640166 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f993a0b7-a945-4cb2-81ee-1fd8e9417a8c tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:26:31.640941 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f993a0b7-a945-4cb2-81ee-1fd8e9417a8c tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:26:31.641407 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f993a0b7-a945-4cb2-81ee-1fd8e9417a8c tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:26:31.878426 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-f993a0b7-a945-4cb2-81ee-1fd8e9417a8c tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a299663b56b411b9fc910ddf47103e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d58bceb8414b02a1bbaec0db07d85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:26:31.886260 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-f993a0b7-a945-4cb2-81ee-1fd8e9417a8c tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] 10.222.0.20 "GET /compute/v2.1/servers/b2829ff8-193e-4095-aec6-4abfe1c5e678" status: 200 len: 1209 microversion: 2.1 time: 0.260071 Jul 22 11:26:31.887027 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 552/1124] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:26:31 2022] GET /compute/v2.1/servers/b2829ff8-193e-4095-aec6-4abfe1c5e678 => generated 1209 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:26:32.903431 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-7fe5ef68-9f75-4b2a-8419-abe04a31dde3 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:26:32.904072 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-7fe5ef68-9f75-4b2a-8419-abe04a31dde3 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] [instance: b2829ff8-193e-4095-aec6-4abfe1c5e678] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:26:32.912771 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7fe5ef68-9f75-4b2a-8419-abe04a31dde3 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:26:32.913232 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7fe5ef68-9f75-4b2a-8419-abe04a31dde3 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:26:32.914019 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7fe5ef68-9f75-4b2a-8419-abe04a31dde3 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:26:32.914464 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7fe5ef68-9f75-4b2a-8419-abe04a31dde3 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:26:33.067525 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-7fe5ef68-9f75-4b2a-8419-abe04a31dde3 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a299663b56b411b9fc910ddf47103e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d58bceb8414b02a1bbaec0db07d85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:26:33.077769 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-7fe5ef68-9f75-4b2a-8419-abe04a31dde3 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] 10.222.0.20 "GET /compute/v2.1/servers/b2829ff8-193e-4095-aec6-4abfe1c5e678" status: 200 len: 1265 microversion: 2.1 time: 0.178183 Jul 22 11:26:33.079444 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 573/1125] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:26:32 2022] GET /compute/v2.1/servers/b2829ff8-193e-4095-aec6-4abfe1c5e678 => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:26:33.227933 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [req-ebed6a19-da68-44aa-9be0-fe35b115c6ed req-8d71bd45-5ea9-4175-80c4-f348c43fa501 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2829ff8-193e-4095-aec6-4abfe1c5e678", "tag": "2f8a2b4d-4aa6-4af7-b7eb-f82c735a2555"}]} {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:26:33.241619 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-ebed6a19-da68-44aa-9be0-fe35b115c6ed req-8d71bd45-5ea9-4175-80c4-f348c43fa501 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:26:33.242393 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-ebed6a19-da68-44aa-9be0-fe35b115c6ed req-8d71bd45-5ea9-4175-80c4-f348c43fa501 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:26:33.260432 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.compute.server_external_events [req-ebed6a19-da68-44aa-9be0-fe35b115c6ed req-8d71bd45-5ea9-4175-80c4-f348c43fa501 service nova] Creating event network-changed:2f8a2b4d-4aa6-4af7-b7eb-f82c735a2555 for instance b2829ff8-193e-4095-aec6-4abfe1c5e678 on hv-cinder-84890 Jul 22 11:26:33.267942 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [req-ebed6a19-da68-44aa-9be0-fe35b115c6ed req-8d71bd45-5ea9-4175-80c4-f348c43fa501 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052834 Jul 22 11:26:33.268554 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 553/1126] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:26:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:26:34.096047 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-eba02b7d-f4e8-4f7e-a9f2-e34da988f322 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:26:34.096905 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-eba02b7d-f4e8-4f7e-a9f2-e34da988f322 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] [instance: b2829ff8-193e-4095-aec6-4abfe1c5e678] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:26:34.103416 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-eba02b7d-f4e8-4f7e-a9f2-e34da988f322 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:26:34.103868 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-eba02b7d-f4e8-4f7e-a9f2-e34da988f322 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:26:34.104639 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-eba02b7d-f4e8-4f7e-a9f2-e34da988f322 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:26:34.105068 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-eba02b7d-f4e8-4f7e-a9f2-e34da988f322 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:26:34.256884 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-eba02b7d-f4e8-4f7e-a9f2-e34da988f322 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a299663b56b411b9fc910ddf47103e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d58bceb8414b02a1bbaec0db07d85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:26:34.265129 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-eba02b7d-f4e8-4f7e-a9f2-e34da988f322 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] 10.222.0.20 "GET /compute/v2.1/servers/b2829ff8-193e-4095-aec6-4abfe1c5e678" status: 200 len: 1265 microversion: 2.1 time: 0.173002 Jul 22 11:26:34.265716 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 574/1127] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:26:34 2022] GET /compute/v2.1/servers/b2829ff8-193e-4095-aec6-4abfe1c5e678 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:26:35.173950 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 22 11:26:35.174426 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Fri Jul 22 11:26:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 22 11:26:35.282124 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-88d54b4a-2c67-447f-a36f-88acb2f7d1b8 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:26:35.282821 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-88d54b4a-2c67-447f-a36f-88acb2f7d1b8 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] [instance: b2829ff8-193e-4095-aec6-4abfe1c5e678] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:26:35.290241 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-88d54b4a-2c67-447f-a36f-88acb2f7d1b8 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:26:35.290685 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-88d54b4a-2c67-447f-a36f-88acb2f7d1b8 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:26:35.291484 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-88d54b4a-2c67-447f-a36f-88acb2f7d1b8 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:26:35.292555 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-88d54b4a-2c67-447f-a36f-88acb2f7d1b8 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:26:35.426331 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-88d54b4a-2c67-447f-a36f-88acb2f7d1b8 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a299663b56b411b9fc910ddf47103e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d58bceb8414b02a1bbaec0db07d85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:26:35.433933 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-88d54b4a-2c67-447f-a36f-88acb2f7d1b8 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] 10.222.0.20 "GET /compute/v2.1/servers/b2829ff8-193e-4095-aec6-4abfe1c5e678" status: 200 len: 1265 microversion: 2.1 time: 0.156015 Jul 22 11:26:35.434501 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 554/1128] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:26:35 2022] GET /compute/v2.1/servers/b2829ff8-193e-4095-aec6-4abfe1c5e678 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:26:36.450489 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-56d45f26-f99b-478d-85e5-b6b649fe1406 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:26:36.451092 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-56d45f26-f99b-478d-85e5-b6b649fe1406 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] [instance: b2829ff8-193e-4095-aec6-4abfe1c5e678] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:26:36.457063 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-56d45f26-f99b-478d-85e5-b6b649fe1406 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:26:36.457505 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-56d45f26-f99b-478d-85e5-b6b649fe1406 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:26:36.458278 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-56d45f26-f99b-478d-85e5-b6b649fe1406 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:26:36.458712 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-56d45f26-f99b-478d-85e5-b6b649fe1406 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:26:36.585804 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-56d45f26-f99b-478d-85e5-b6b649fe1406 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a299663b56b411b9fc910ddf47103e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d58bceb8414b02a1bbaec0db07d85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:26:36.594440 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-56d45f26-f99b-478d-85e5-b6b649fe1406 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] 10.222.0.20 "GET /compute/v2.1/servers/b2829ff8-193e-4095-aec6-4abfe1c5e678" status: 200 len: 1265 microversion: 2.1 time: 0.147940 Jul 22 11:26:36.595250 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 575/1129] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:26:36 2022] GET /compute/v2.1/servers/b2829ff8-193e-4095-aec6-4abfe1c5e678 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:26:37.021349 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-d50a8b7d-c806-480d-bd51-fa23155c67b7 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:26:37.021902 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-d50a8b7d-c806-480d-bd51-fa23155c67b7 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] [instance: 3e342bc0-ddb4-4b26-9d31-04210b39c81c] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:26:37.028957 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-d50a8b7d-c806-480d-bd51-fa23155c67b7 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:26:37.029399 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-d50a8b7d-c806-480d-bd51-fa23155c67b7 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:26:37.030152 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-d50a8b7d-c806-480d-bd51-fa23155c67b7 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:26:37.030585 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-d50a8b7d-c806-480d-bd51-fa23155c67b7 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:26:37.052429 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.objects.instance [None req-d50a8b7d-c806-480d-bd51-fa23155c67b7 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lazy-loading 'flavor' on Instance uuid 3e342bc0-ddb4-4b26-9d31-04210b39c81c {{(pid=117884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 22 11:26:37.141989 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-d50a8b7d-c806-480d-bd51-fa23155c67b7 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] 10.222.0.20 "POST /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c/action" status: 202 len: 0 microversion: 2.1 time: 0.124430 Jul 22 11:26:37.142678 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 555/1130] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Jul 22 11:26:37 2022] POST /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 22 11:26:37.153246 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-36531261-bd87-4f1e-a3bd-7ad44a88758f tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:26:37.154113 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-36531261-bd87-4f1e-a3bd-7ad44a88758f tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] [instance: 3e342bc0-ddb4-4b26-9d31-04210b39c81c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:26:37.164244 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-36531261-bd87-4f1e-a3bd-7ad44a88758f tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:26:37.165788 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-36531261-bd87-4f1e-a3bd-7ad44a88758f tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:26:37.167365 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-36531261-bd87-4f1e-a3bd-7ad44a88758f tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:26:37.167966 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-36531261-bd87-4f1e-a3bd-7ad44a88758f tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:26:37.550474 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-36531261-bd87-4f1e-a3bd-7ad44a88758f tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af2fb64a6c4a4ea660196aa90a9c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd084bf56f7894fb98a46d7e2cbb34157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:26:37.558506 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-36531261-bd87-4f1e-a3bd-7ad44a88758f tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] 10.222.0.20 "GET /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c" status: 200 len: 1570 microversion: 2.1 time: 0.411424 Jul 22 11:26:37.559068 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 576/1131] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:26:37 2022] GET /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c => generated 1570 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:26:37.611568 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-f20d99ec-2e8f-4ae3-9c6d-2b074429b2cf tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:26:37.612259 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-f20d99ec-2e8f-4ae3-9c6d-2b074429b2cf tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] [instance: b2829ff8-193e-4095-aec6-4abfe1c5e678] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:26:37.618669 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f20d99ec-2e8f-4ae3-9c6d-2b074429b2cf tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:26:37.619114 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f20d99ec-2e8f-4ae3-9c6d-2b074429b2cf tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:26:37.620393 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f20d99ec-2e8f-4ae3-9c6d-2b074429b2cf tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:26:37.620825 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f20d99ec-2e8f-4ae3-9c6d-2b074429b2cf tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:26:37.758805 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-f20d99ec-2e8f-4ae3-9c6d-2b074429b2cf tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a299663b56b411b9fc910ddf47103e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d58bceb8414b02a1bbaec0db07d85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:26:37.766244 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-f20d99ec-2e8f-4ae3-9c6d-2b074429b2cf tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] 10.222.0.20 "GET /compute/v2.1/servers/b2829ff8-193e-4095-aec6-4abfe1c5e678" status: 200 len: 1265 microversion: 2.1 time: 0.158960 Jul 22 11:26:37.766815 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 556/1132] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:26:37 2022] GET /compute/v2.1/servers/b2829ff8-193e-4095-aec6-4abfe1c5e678 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:26:38.577533 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-000e9565-254d-4561-94dd-d747e5afdfed tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:26:38.578184 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-000e9565-254d-4561-94dd-d747e5afdfed tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] [instance: 3e342bc0-ddb4-4b26-9d31-04210b39c81c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:26:38.584673 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-000e9565-254d-4561-94dd-d747e5afdfed tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:26:38.585123 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-000e9565-254d-4561-94dd-d747e5afdfed tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:26:38.585889 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-000e9565-254d-4561-94dd-d747e5afdfed tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:26:38.586328 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-000e9565-254d-4561-94dd-d747e5afdfed tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:26:38.719829 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-000e9565-254d-4561-94dd-d747e5afdfed tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af2fb64a6c4a4ea660196aa90a9c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd084bf56f7894fb98a46d7e2cbb34157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:26:38.727545 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-000e9565-254d-4561-94dd-d747e5afdfed tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] 10.222.0.20 "GET /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c" status: 200 len: 1570 microversion: 2.1 time: 0.154322 Jul 22 11:26:38.728146 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 577/1133] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:26:38 2022] GET /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:26:38.783126 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-40fd0fcc-05ef-4bb7-973c-6b6c0e95771e tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:26:38.783746 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-40fd0fcc-05ef-4bb7-973c-6b6c0e95771e tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] [instance: b2829ff8-193e-4095-aec6-4abfe1c5e678] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:26:38.790176 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-40fd0fcc-05ef-4bb7-973c-6b6c0e95771e tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:26:38.790622 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-40fd0fcc-05ef-4bb7-973c-6b6c0e95771e tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:26:38.791407 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-40fd0fcc-05ef-4bb7-973c-6b6c0e95771e tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:26:38.791857 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-40fd0fcc-05ef-4bb7-973c-6b6c0e95771e tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:26:38.923510 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-40fd0fcc-05ef-4bb7-973c-6b6c0e95771e tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a299663b56b411b9fc910ddf47103e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d58bceb8414b02a1bbaec0db07d85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:26:38.930865 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-40fd0fcc-05ef-4bb7-973c-6b6c0e95771e tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] 10.222.0.20 "GET /compute/v2.1/servers/b2829ff8-193e-4095-aec6-4abfe1c5e678" status: 200 len: 1265 microversion: 2.1 time: 0.151619 Jul 22 11:26:38.931451 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 557/1134] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:26:38 2022] GET /compute/v2.1/servers/b2829ff8-193e-4095-aec6-4abfe1c5e678 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:26:39.748520 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-5fdbb2c4-b546-456c-9686-2313caeb7504 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:26:39.749154 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-5fdbb2c4-b546-456c-9686-2313caeb7504 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] [instance: 3e342bc0-ddb4-4b26-9d31-04210b39c81c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:26:39.755690 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5fdbb2c4-b546-456c-9686-2313caeb7504 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:26:39.756135 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5fdbb2c4-b546-456c-9686-2313caeb7504 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:26:39.756901 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5fdbb2c4-b546-456c-9686-2313caeb7504 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:26:39.757334 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5fdbb2c4-b546-456c-9686-2313caeb7504 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:26:39.890466 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-5fdbb2c4-b546-456c-9686-2313caeb7504 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af2fb64a6c4a4ea660196aa90a9c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd084bf56f7894fb98a46d7e2cbb34157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:26:39.898715 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-5fdbb2c4-b546-456c-9686-2313caeb7504 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] 10.222.0.20 "GET /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c" status: 200 len: 1570 microversion: 2.1 time: 0.154562 Jul 22 11:26:39.899303 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 578/1135] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:26:39 2022] GET /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:26:39.948360 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-fa1ce0c5-ce45-412b-b934-c0a24ed23995 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:26:39.948967 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-fa1ce0c5-ce45-412b-b934-c0a24ed23995 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] [instance: b2829ff8-193e-4095-aec6-4abfe1c5e678] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:26:39.955388 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-fa1ce0c5-ce45-412b-b934-c0a24ed23995 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:26:39.955832 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-fa1ce0c5-ce45-412b-b934-c0a24ed23995 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:26:39.956590 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-fa1ce0c5-ce45-412b-b934-c0a24ed23995 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:26:39.957016 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-fa1ce0c5-ce45-412b-b934-c0a24ed23995 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:26:40.087124 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-fa1ce0c5-ce45-412b-b934-c0a24ed23995 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a299663b56b411b9fc910ddf47103e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d58bceb8414b02a1bbaec0db07d85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:26:40.094587 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-fa1ce0c5-ce45-412b-b934-c0a24ed23995 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] 10.222.0.20 "GET /compute/v2.1/servers/b2829ff8-193e-4095-aec6-4abfe1c5e678" status: 200 len: 1265 microversion: 2.1 time: 0.150697 Jul 22 11:26:40.095148 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 558/1136] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:26:39 2022] GET /compute/v2.1/servers/b2829ff8-193e-4095-aec6-4abfe1c5e678 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:26:40.916096 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-0f6a1464-b1f1-436e-8f04-028a13ef2ba7 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:26:40.916528 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-0f6a1464-b1f1-436e-8f04-028a13ef2ba7 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] [instance: 3e342bc0-ddb4-4b26-9d31-04210b39c81c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:26:40.918243 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell0:SELECT=2 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:26:40.923989 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0f6a1464-b1f1-436e-8f04-028a13ef2ba7 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:26:40.924440 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0f6a1464-b1f1-436e-8f04-028a13ef2ba7 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:26:40.925310 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0f6a1464-b1f1-436e-8f04-028a13ef2ba7 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:26:40.925729 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0f6a1464-b1f1-436e-8f04-028a13ef2ba7 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:26:41.075177 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-0f6a1464-b1f1-436e-8f04-028a13ef2ba7 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af2fb64a6c4a4ea660196aa90a9c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd084bf56f7894fb98a46d7e2cbb34157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:26:41.083048 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-0f6a1464-b1f1-436e-8f04-028a13ef2ba7 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] 10.222.0.20 "GET /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c" status: 200 len: 1570 microversion: 2.1 time: 0.171296 Jul 22 11:26:41.083768 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 579/1137] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:26:40 2022] GET /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c => generated 1570 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:26:41.111237 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-f9d113d9-dce1-4c76-b418-1f67e1f56c39 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:26:41.111916 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-f9d113d9-dce1-4c76-b418-1f67e1f56c39 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] [instance: b2829ff8-193e-4095-aec6-4abfe1c5e678] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:26:41.113726 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG dbcounter [-] [117884] Writing DB stats nova_cell0:SELECT=2 {{(pid=117884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:26:41.114377 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG dbcounter [-] [117884] Writing DB stats nova_cell0:SELECT=6 {{(pid=117884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:26:41.122162 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f9d113d9-dce1-4c76-b418-1f67e1f56c39 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:26:41.122607 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f9d113d9-dce1-4c76-b418-1f67e1f56c39 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:26:41.123408 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f9d113d9-dce1-4c76-b418-1f67e1f56c39 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:26:41.123840 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-f9d113d9-dce1-4c76-b418-1f67e1f56c39 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:26:41.259428 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-f9d113d9-dce1-4c76-b418-1f67e1f56c39 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a299663b56b411b9fc910ddf47103e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d58bceb8414b02a1bbaec0db07d85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:26:41.267673 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-f9d113d9-dce1-4c76-b418-1f67e1f56c39 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] 10.222.0.20 "GET /compute/v2.1/servers/b2829ff8-193e-4095-aec6-4abfe1c5e678" status: 200 len: 1265 microversion: 2.1 time: 0.160329 Jul 22 11:26:41.268238 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 559/1138] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:26:41 2022] GET /compute/v2.1/servers/b2829ff8-193e-4095-aec6-4abfe1c5e678 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:26:42.100702 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-4b442c14-120a-435e-bd1c-5674ee1dbbf9 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:26:42.101353 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-4b442c14-120a-435e-bd1c-5674ee1dbbf9 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] [instance: 3e342bc0-ddb4-4b26-9d31-04210b39c81c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:26:42.108406 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4b442c14-120a-435e-bd1c-5674ee1dbbf9 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:26:42.108850 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4b442c14-120a-435e-bd1c-5674ee1dbbf9 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:26:42.109612 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4b442c14-120a-435e-bd1c-5674ee1dbbf9 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:26:42.110040 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4b442c14-120a-435e-bd1c-5674ee1dbbf9 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:26:42.243799 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-4b442c14-120a-435e-bd1c-5674ee1dbbf9 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af2fb64a6c4a4ea660196aa90a9c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd084bf56f7894fb98a46d7e2cbb34157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:26:42.251509 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-4b442c14-120a-435e-bd1c-5674ee1dbbf9 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] 10.222.0.20 "GET /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c" status: 200 len: 1570 microversion: 2.1 time: 0.154628 Jul 22 11:26:42.252085 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 580/1139] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:26:42 2022] GET /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:26:42.284381 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-bb5cc297-8d42-4dfb-9d41-89c44c57f9b2 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:26:42.285012 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-bb5cc297-8d42-4dfb-9d41-89c44c57f9b2 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] [instance: b2829ff8-193e-4095-aec6-4abfe1c5e678] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:26:42.291774 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-bb5cc297-8d42-4dfb-9d41-89c44c57f9b2 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:26:42.292220 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-bb5cc297-8d42-4dfb-9d41-89c44c57f9b2 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:26:42.292997 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-bb5cc297-8d42-4dfb-9d41-89c44c57f9b2 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:26:42.293432 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-bb5cc297-8d42-4dfb-9d41-89c44c57f9b2 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:26:42.428986 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-bb5cc297-8d42-4dfb-9d41-89c44c57f9b2 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a299663b56b411b9fc910ddf47103e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d58bceb8414b02a1bbaec0db07d85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:26:42.436483 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-bb5cc297-8d42-4dfb-9d41-89c44c57f9b2 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] 10.222.0.20 "GET /compute/v2.1/servers/b2829ff8-193e-4095-aec6-4abfe1c5e678" status: 200 len: 1265 microversion: 2.1 time: 0.156045 Jul 22 11:26:42.437066 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 560/1140] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:26:42 2022] GET /compute/v2.1/servers/b2829ff8-193e-4095-aec6-4abfe1c5e678 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:26:43.159375 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-1cbd87c2-7bfa-4f99-9304-fd6d71c80730 req-732529c5-324f-431d-b9db-21be4e645bf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2829ff8-193e-4095-aec6-4abfe1c5e678", "name": "network-vif-plugged", "status": "completed", "tag": "2f8a2b4d-4aa6-4af7-b7eb-f82c735a2555"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:26:43.168246 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-1cbd87c2-7bfa-4f99-9304-fd6d71c80730 req-732529c5-324f-431d-b9db-21be4e645bf4 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:26:43.168700 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-1cbd87c2-7bfa-4f99-9304-fd6d71c80730 req-732529c5-324f-431d-b9db-21be4e645bf4 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:26:43.179515 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-1cbd87c2-7bfa-4f99-9304-fd6d71c80730 req-732529c5-324f-431d-b9db-21be4e645bf4 service nova] Creating event network-vif-plugged:2f8a2b4d-4aa6-4af7-b7eb-f82c735a2555 for instance b2829ff8-193e-4095-aec6-4abfe1c5e678 on hv-cinder-84890 Jul 22 11:26:43.185319 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-1cbd87c2-7bfa-4f99-9304-fd6d71c80730 req-732529c5-324f-431d-b9db-21be4e645bf4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.274460 Jul 22 11:26:43.186032 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 581/1141] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:26:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:26:43.269195 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-537e2542-0855-42a0-abb1-58d38a55cb5f tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:26:43.269800 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-537e2542-0855-42a0-abb1-58d38a55cb5f tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] [instance: 3e342bc0-ddb4-4b26-9d31-04210b39c81c] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:26:43.276334 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-537e2542-0855-42a0-abb1-58d38a55cb5f tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:26:43.276900 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-537e2542-0855-42a0-abb1-58d38a55cb5f tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:26:43.277671 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-537e2542-0855-42a0-abb1-58d38a55cb5f tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:26:43.278102 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-537e2542-0855-42a0-abb1-58d38a55cb5f tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:26:43.453856 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-76a1d708-0202-438b-a0e1-39287aff4bc7 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:26:43.454554 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-76a1d708-0202-438b-a0e1-39287aff4bc7 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] [instance: b2829ff8-193e-4095-aec6-4abfe1c5e678] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:26:43.461252 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-76a1d708-0202-438b-a0e1-39287aff4bc7 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:26:43.461781 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-76a1d708-0202-438b-a0e1-39287aff4bc7 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:26:43.462634 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-76a1d708-0202-438b-a0e1-39287aff4bc7 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:26:43.463056 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-76a1d708-0202-438b-a0e1-39287aff4bc7 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:26:43.466704 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-537e2542-0855-42a0-abb1-58d38a55cb5f tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af2fb64a6c4a4ea660196aa90a9c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd084bf56f7894fb98a46d7e2cbb34157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:26:43.475936 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-537e2542-0855-42a0-abb1-58d38a55cb5f tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] 10.222.0.20 "GET /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c" status: 200 len: 1570 microversion: 2.1 time: 0.210535 Jul 22 11:26:43.476519 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 561/1142] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:26:43 2022] GET /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c => generated 1570 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:26:43.611849 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-76a1d708-0202-438b-a0e1-39287aff4bc7 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a299663b56b411b9fc910ddf47103e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d58bceb8414b02a1bbaec0db07d85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:26:43.619626 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-76a1d708-0202-438b-a0e1-39287aff4bc7 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] 10.222.0.20 "GET /compute/v2.1/servers/b2829ff8-193e-4095-aec6-4abfe1c5e678" status: 200 len: 1265 microversion: 2.1 time: 0.169980 Jul 22 11:26:43.620199 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 582/1143] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:26:43 2022] GET /compute/v2.1/servers/b2829ff8-193e-4095-aec6-4abfe1c5e678 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:26:44.496887 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-44204cfa-28e4-472b-8bcd-3d823f2c88c9 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:26:44.497919 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-44204cfa-28e4-472b-8bcd-3d823f2c88c9 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] [instance: 3e342bc0-ddb4-4b26-9d31-04210b39c81c] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:26:44.504875 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-44204cfa-28e4-472b-8bcd-3d823f2c88c9 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:26:44.505324 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-44204cfa-28e4-472b-8bcd-3d823f2c88c9 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:26:44.506112 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-44204cfa-28e4-472b-8bcd-3d823f2c88c9 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:26:44.506547 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-44204cfa-28e4-472b-8bcd-3d823f2c88c9 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:26:44.640212 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-bb990939-04bc-45f4-a4f8-0685a121ccf1 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:26:44.641293 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-bb990939-04bc-45f4-a4f8-0685a121ccf1 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] [instance: b2829ff8-193e-4095-aec6-4abfe1c5e678] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:26:44.653504 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-bb990939-04bc-45f4-a4f8-0685a121ccf1 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:26:44.654100 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-bb990939-04bc-45f4-a4f8-0685a121ccf1 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:26:44.655402 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-bb990939-04bc-45f4-a4f8-0685a121ccf1 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:26:44.656196 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-bb990939-04bc-45f4-a4f8-0685a121ccf1 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:26:44.664420 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-44204cfa-28e4-472b-8bcd-3d823f2c88c9 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af2fb64a6c4a4ea660196aa90a9c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd084bf56f7894fb98a46d7e2cbb34157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:26:44.675288 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-44204cfa-28e4-472b-8bcd-3d823f2c88c9 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] 10.222.0.20 "GET /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c" status: 200 len: 1570 microversion: 2.1 time: 0.184839 Jul 22 11:26:44.675917 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 562/1144] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:26:44 2022] GET /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c => generated 1570 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:26:44.805105 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-bb990939-04bc-45f4-a4f8-0685a121ccf1 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a299663b56b411b9fc910ddf47103e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d58bceb8414b02a1bbaec0db07d85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:26:44.813410 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-bb990939-04bc-45f4-a4f8-0685a121ccf1 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] 10.222.0.20 "GET /compute/v2.1/servers/b2829ff8-193e-4095-aec6-4abfe1c5e678" status: 200 len: 1453 microversion: 2.1 time: 0.179660 Jul 22 11:26:44.813996 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 583/1145] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:26:44 2022] GET /compute/v2.1/servers/b2829ff8-193e-4095-aec6-4abfe1c5e678 => generated 1453 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:26:44.830925 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-1e60321d-1435-4bf5-911a-a8967e02f3e3 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:26:44.831583 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-1e60321d-1435-4bf5-911a-a8967e02f3e3 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] [instance: b2829ff8-193e-4095-aec6-4abfe1c5e678] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:26:44.838715 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-1e60321d-1435-4bf5-911a-a8967e02f3e3 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:26:44.839434 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-1e60321d-1435-4bf5-911a-a8967e02f3e3 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:26:44.840232 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-1e60321d-1435-4bf5-911a-a8967e02f3e3 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:26:44.840710 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-1e60321d-1435-4bf5-911a-a8967e02f3e3 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:26:44.989563 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-1e60321d-1435-4bf5-911a-a8967e02f3e3 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a299663b56b411b9fc910ddf47103e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d58bceb8414b02a1bbaec0db07d85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:26:44.999485 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-1e60321d-1435-4bf5-911a-a8967e02f3e3 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] 10.222.0.20 "GET /compute/v2.1/servers/b2829ff8-193e-4095-aec6-4abfe1c5e678" status: 200 len: 1453 microversion: 2.1 time: 0.173285 Jul 22 11:26:45.000016 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 563/1146] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:26:44 2022] GET /compute/v2.1/servers/b2829ff8-193e-4095-aec6-4abfe1c5e678 => generated 1453 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:26:45.693750 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-d0f60f68-78f9-4b58-bb14-fc895d583bc3 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:26:45.694488 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-d0f60f68-78f9-4b58-bb14-fc895d583bc3 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] [instance: 3e342bc0-ddb4-4b26-9d31-04210b39c81c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:26:45.702349 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d0f60f68-78f9-4b58-bb14-fc895d583bc3 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:26:45.702805 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d0f60f68-78f9-4b58-bb14-fc895d583bc3 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:26:45.703694 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d0f60f68-78f9-4b58-bb14-fc895d583bc3 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:26:45.704129 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d0f60f68-78f9-4b58-bb14-fc895d583bc3 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:26:45.874065 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-d0f60f68-78f9-4b58-bb14-fc895d583bc3 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af2fb64a6c4a4ea660196aa90a9c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd084bf56f7894fb98a46d7e2cbb34157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:26:45.882952 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-d0f60f68-78f9-4b58-bb14-fc895d583bc3 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] 10.222.0.20 "GET /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c" status: 200 len: 1570 microversion: 2.1 time: 0.192889 Jul 22 11:26:45.883765 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 584/1147] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:26:45 2022] GET /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c => generated 1570 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:26:46.782042 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [req-06c0f393-d9ec-49c5-87a6-5f1948f3dce2 req-0dcc3230-597e-4df9-8e67-639a77d0d3ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2829ff8-193e-4095-aec6-4abfe1c5e678", "tag": "2f8a2b4d-4aa6-4af7-b7eb-f82c735a2555"}]} {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:26:46.791232 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-06c0f393-d9ec-49c5-87a6-5f1948f3dce2 req-0dcc3230-597e-4df9-8e67-639a77d0d3ee service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:26:46.791698 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-06c0f393-d9ec-49c5-87a6-5f1948f3dce2 req-0dcc3230-597e-4df9-8e67-639a77d0d3ee service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:26:46.802964 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.compute.server_external_events [req-06c0f393-d9ec-49c5-87a6-5f1948f3dce2 req-0dcc3230-597e-4df9-8e67-639a77d0d3ee service nova] Creating event network-changed:2f8a2b4d-4aa6-4af7-b7eb-f82c735a2555 for instance b2829ff8-193e-4095-aec6-4abfe1c5e678 on hv-cinder-84890 Jul 22 11:26:46.808063 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [req-06c0f393-d9ec-49c5-87a6-5f1948f3dce2 req-0dcc3230-597e-4df9-8e67-639a77d0d3ee service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029819 Jul 22 11:26:46.808720 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 564/1148] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:26:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:26:46.902785 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-6582b22f-a00f-49da-8464-edf7593c661f tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:26:46.903561 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-6582b22f-a00f-49da-8464-edf7593c661f tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] [instance: 3e342bc0-ddb4-4b26-9d31-04210b39c81c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:26:46.910364 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6582b22f-a00f-49da-8464-edf7593c661f tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:26:46.910899 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6582b22f-a00f-49da-8464-edf7593c661f tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:26:46.911787 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6582b22f-a00f-49da-8464-edf7593c661f tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:26:46.912294 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6582b22f-a00f-49da-8464-edf7593c661f tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:26:47.053817 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-6582b22f-a00f-49da-8464-edf7593c661f tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af2fb64a6c4a4ea660196aa90a9c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd084bf56f7894fb98a46d7e2cbb34157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:26:47.061540 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-6582b22f-a00f-49da-8464-edf7593c661f tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] 10.222.0.20 "GET /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c" status: 200 len: 1570 microversion: 2.1 time: 0.163383 Jul 22 11:26:47.062110 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 585/1149] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:26:46 2022] GET /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c => generated 1570 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:26:48.078741 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-0fa3bea5-d475-4c1f-a27a-28f441ef8227 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:26:48.079919 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-0fa3bea5-d475-4c1f-a27a-28f441ef8227 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] [instance: 3e342bc0-ddb4-4b26-9d31-04210b39c81c] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:26:48.085866 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-0fa3bea5-d475-4c1f-a27a-28f441ef8227 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:26:48.086318 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-0fa3bea5-d475-4c1f-a27a-28f441ef8227 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:26:48.087092 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-0fa3bea5-d475-4c1f-a27a-28f441ef8227 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:26:48.087565 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-0fa3bea5-d475-4c1f-a27a-28f441ef8227 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:26:48.242800 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-0fa3bea5-d475-4c1f-a27a-28f441ef8227 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af2fb64a6c4a4ea660196aa90a9c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd084bf56f7894fb98a46d7e2cbb34157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:26:48.250601 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-0fa3bea5-d475-4c1f-a27a-28f441ef8227 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] 10.222.0.20 "GET /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c" status: 200 len: 1570 microversion: 2.1 time: 0.176660 Jul 22 11:26:48.251184 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 565/1150] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:26:48 2022] GET /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c => generated 1570 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:26:49.268397 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-b1338dc8-d551-4923-9868-849071f1ce9f tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:26:49.268984 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-b1338dc8-d551-4923-9868-849071f1ce9f tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] [instance: 3e342bc0-ddb4-4b26-9d31-04210b39c81c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:26:49.275653 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b1338dc8-d551-4923-9868-849071f1ce9f tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:26:49.276095 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b1338dc8-d551-4923-9868-849071f1ce9f tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:26:49.276846 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b1338dc8-d551-4923-9868-849071f1ce9f tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:26:49.277271 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b1338dc8-d551-4923-9868-849071f1ce9f tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:26:49.420892 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-b1338dc8-d551-4923-9868-849071f1ce9f tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af2fb64a6c4a4ea660196aa90a9c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd084bf56f7894fb98a46d7e2cbb34157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:26:49.428388 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-b1338dc8-d551-4923-9868-849071f1ce9f tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] 10.222.0.20 "GET /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c" status: 200 len: 1570 microversion: 2.1 time: 0.163888 Jul 22 11:26:49.428960 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 586/1151] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:26:49 2022] GET /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c => generated 1570 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:26:50.445724 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-9d3dbd9e-25dd-414f-b95c-2b74ab929152 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:26:50.446318 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-9d3dbd9e-25dd-414f-b95c-2b74ab929152 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] [instance: 3e342bc0-ddb4-4b26-9d31-04210b39c81c] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:26:50.453527 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-9d3dbd9e-25dd-414f-b95c-2b74ab929152 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:26:50.453973 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-9d3dbd9e-25dd-414f-b95c-2b74ab929152 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:26:50.454736 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-9d3dbd9e-25dd-414f-b95c-2b74ab929152 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:26:50.455166 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-9d3dbd9e-25dd-414f-b95c-2b74ab929152 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:26:50.582243 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-9d3dbd9e-25dd-414f-b95c-2b74ab929152 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af2fb64a6c4a4ea660196aa90a9c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd084bf56f7894fb98a46d7e2cbb34157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:26:50.589721 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-9d3dbd9e-25dd-414f-b95c-2b74ab929152 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] 10.222.0.20 "GET /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c" status: 200 len: 1511 microversion: 2.1 time: 0.147934 Jul 22 11:26:50.590282 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 566/1152] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:26:50 2022] GET /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c => generated 1511 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:26:50.606265 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-3d51d3a2-7aed-4b29-8480-d092ccf91b4c tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:26:50.606839 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-3d51d3a2-7aed-4b29-8480-d092ccf91b4c tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] [instance: 3e342bc0-ddb4-4b26-9d31-04210b39c81c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:26:50.613321 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3d51d3a2-7aed-4b29-8480-d092ccf91b4c tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:26:50.613764 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3d51d3a2-7aed-4b29-8480-d092ccf91b4c tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:26:50.614528 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3d51d3a2-7aed-4b29-8480-d092ccf91b4c tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:26:50.614986 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3d51d3a2-7aed-4b29-8480-d092ccf91b4c tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:26:50.689210 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-3d51d3a2-7aed-4b29-8480-d092ccf91b4c tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] 10.222.0.20 "POST /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c/action" status: 202 len: 0 microversion: 2.1 time: 0.087306 Jul 22 11:26:50.692766 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 587/1153] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Jul 22 11:26:50 2022] POST /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 22 11:26:50.698067 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-78e80ad4-8a0c-4081-aa6f-e39260f5d5d3 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:26:50.698620 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-78e80ad4-8a0c-4081-aa6f-e39260f5d5d3 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] [instance: 3e342bc0-ddb4-4b26-9d31-04210b39c81c] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:26:50.704926 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-78e80ad4-8a0c-4081-aa6f-e39260f5d5d3 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:26:50.705488 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-78e80ad4-8a0c-4081-aa6f-e39260f5d5d3 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:26:50.706251 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-78e80ad4-8a0c-4081-aa6f-e39260f5d5d3 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:26:50.706680 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-78e80ad4-8a0c-4081-aa6f-e39260f5d5d3 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:26:50.725357 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG dbcounter [-] [117884] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:26:51.141361 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-78e80ad4-8a0c-4081-aa6f-e39260f5d5d3 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af2fb64a6c4a4ea660196aa90a9c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd084bf56f7894fb98a46d7e2cbb34157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:26:51.148981 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-78e80ad4-8a0c-4081-aa6f-e39260f5d5d3 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] 10.222.0.20 "GET /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c" status: 200 len: 1519 microversion: 2.1 time: 0.454924 Jul 22 11:26:51.149560 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 567/1154] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:26:50 2022] GET /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c => generated 1519 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:26:52.168962 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-16066c86-a2d5-4d39-b802-d84c2e1262a1 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:26:52.169804 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-16066c86-a2d5-4d39-b802-d84c2e1262a1 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] [instance: 3e342bc0-ddb4-4b26-9d31-04210b39c81c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:26:52.176098 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-16066c86-a2d5-4d39-b802-d84c2e1262a1 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:26:52.176602 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-16066c86-a2d5-4d39-b802-d84c2e1262a1 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:26:52.177370 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-16066c86-a2d5-4d39-b802-d84c2e1262a1 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:26:52.177802 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-16066c86-a2d5-4d39-b802-d84c2e1262a1 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:26:52.315225 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-16066c86-a2d5-4d39-b802-d84c2e1262a1 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af2fb64a6c4a4ea660196aa90a9c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd084bf56f7894fb98a46d7e2cbb34157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:26:52.322914 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-16066c86-a2d5-4d39-b802-d84c2e1262a1 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] 10.222.0.20 "GET /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c" status: 200 len: 1577 microversion: 2.1 time: 0.159105 Jul 22 11:26:52.323616 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 588/1155] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:26:52 2022] GET /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:26:52.980968 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [req-a6e14688-f0f7-4140-a9f5-87af546e51bf req-b64e6119-fbea-48c2-99c3-cb939109d355 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e342bc0-ddb4-4b26-9d31-04210b39c81c", "name": "network-vif-unplugged", "status": "completed", "tag": "05eda950-e6f4-4f38-86a7-bf112af47c3b"}]} {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:26:52.990220 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-a6e14688-f0f7-4140-a9f5-87af546e51bf req-b64e6119-fbea-48c2-99c3-cb939109d355 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:26:52.991004 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-a6e14688-f0f7-4140-a9f5-87af546e51bf req-b64e6119-fbea-48c2-99c3-cb939109d355 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:26:53.006068 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.compute.server_external_events [req-a6e14688-f0f7-4140-a9f5-87af546e51bf req-b64e6119-fbea-48c2-99c3-cb939109d355 service nova] Creating event network-vif-unplugged:05eda950-e6f4-4f38-86a7-bf112af47c3b for instance 3e342bc0-ddb4-4b26-9d31-04210b39c81c on hv-cinder-84890 Jul 22 11:26:53.015361 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [req-a6e14688-f0f7-4140-a9f5-87af546e51bf req-b64e6119-fbea-48c2-99c3-cb939109d355 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033713 Jul 22 11:26:53.015361 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 568/1156] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:26:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:26:53.340610 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-d11708d3-6f86-4134-b610-7aeac44f2dff tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:26:53.341219 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-d11708d3-6f86-4134-b610-7aeac44f2dff tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] [instance: 3e342bc0-ddb4-4b26-9d31-04210b39c81c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:26:53.348226 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d11708d3-6f86-4134-b610-7aeac44f2dff tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:26:53.348676 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d11708d3-6f86-4134-b610-7aeac44f2dff tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:26:53.349435 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d11708d3-6f86-4134-b610-7aeac44f2dff tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:26:53.349869 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d11708d3-6f86-4134-b610-7aeac44f2dff tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:26:53.354131 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:26:53.490246 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-d11708d3-6f86-4134-b610-7aeac44f2dff tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af2fb64a6c4a4ea660196aa90a9c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd084bf56f7894fb98a46d7e2cbb34157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:26:53.498633 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-d11708d3-6f86-4134-b610-7aeac44f2dff tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] 10.222.0.20 "GET /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c" status: 200 len: 1577 microversion: 2.1 time: 0.161918 Jul 22 11:26:53.499209 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 589/1157] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:26:53 2022] GET /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c => generated 1577 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:26:54.517907 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-74cfefe4-32ee-4d4e-bb27-07f23781aab8 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:26:54.518599 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-74cfefe4-32ee-4d4e-bb27-07f23781aab8 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] [instance: 3e342bc0-ddb4-4b26-9d31-04210b39c81c] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:26:54.524779 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-74cfefe4-32ee-4d4e-bb27-07f23781aab8 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:26:54.525228 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-74cfefe4-32ee-4d4e-bb27-07f23781aab8 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:26:54.525986 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-74cfefe4-32ee-4d4e-bb27-07f23781aab8 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:26:54.527125 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-74cfefe4-32ee-4d4e-bb27-07f23781aab8 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:26:54.657527 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-74cfefe4-32ee-4d4e-bb27-07f23781aab8 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af2fb64a6c4a4ea660196aa90a9c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd084bf56f7894fb98a46d7e2cbb34157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:26:54.664929 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-74cfefe4-32ee-4d4e-bb27-07f23781aab8 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] 10.222.0.20 "GET /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c" status: 200 len: 1577 microversion: 2.1 time: 0.151785 Jul 22 11:26:54.665482 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 569/1158] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:26:54 2022] GET /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:26:55.681782 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-185edcb4-5cb6-4e1a-a0a5-e1d939d1eb8e tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:26:55.682439 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-185edcb4-5cb6-4e1a-a0a5-e1d939d1eb8e tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] [instance: 3e342bc0-ddb4-4b26-9d31-04210b39c81c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:26:55.689630 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-185edcb4-5cb6-4e1a-a0a5-e1d939d1eb8e tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:26:55.690111 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-185edcb4-5cb6-4e1a-a0a5-e1d939d1eb8e tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:26:55.690869 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-185edcb4-5cb6-4e1a-a0a5-e1d939d1eb8e tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:26:55.691326 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-185edcb4-5cb6-4e1a-a0a5-e1d939d1eb8e tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:26:55.824085 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-185edcb4-5cb6-4e1a-a0a5-e1d939d1eb8e tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af2fb64a6c4a4ea660196aa90a9c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd084bf56f7894fb98a46d7e2cbb34157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:26:55.831662 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-185edcb4-5cb6-4e1a-a0a5-e1d939d1eb8e tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] 10.222.0.20 "GET /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c" status: 200 len: 1577 microversion: 2.1 time: 0.153924 Jul 22 11:26:55.832226 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 590/1159] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:26:55 2022] GET /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 11:26:56.849953 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-5b663a98-bd3f-4f59-a300-e2e3d2ab3272 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:26:56.850548 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-5b663a98-bd3f-4f59-a300-e2e3d2ab3272 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] [instance: 3e342bc0-ddb4-4b26-9d31-04210b39c81c] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:26:56.857086 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-5b663a98-bd3f-4f59-a300-e2e3d2ab3272 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:26:56.857535 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-5b663a98-bd3f-4f59-a300-e2e3d2ab3272 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:26:56.858373 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-5b663a98-bd3f-4f59-a300-e2e3d2ab3272 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:26:56.859358 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-5b663a98-bd3f-4f59-a300-e2e3d2ab3272 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:26:56.991833 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-5b663a98-bd3f-4f59-a300-e2e3d2ab3272 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af2fb64a6c4a4ea660196aa90a9c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd084bf56f7894fb98a46d7e2cbb34157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:26:56.999835 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-5b663a98-bd3f-4f59-a300-e2e3d2ab3272 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] 10.222.0.20 "GET /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c" status: 200 len: 1577 microversion: 2.1 time: 0.153920 Jul 22 11:26:57.000401 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 570/1160] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:26:56 2022] GET /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:26:58.016848 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-8f41b608-4823-4085-a192-4e23ef1afd98 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:26:58.017456 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-8f41b608-4823-4085-a192-4e23ef1afd98 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] [instance: 3e342bc0-ddb4-4b26-9d31-04210b39c81c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:26:58.025264 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8f41b608-4823-4085-a192-4e23ef1afd98 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:26:58.025712 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8f41b608-4823-4085-a192-4e23ef1afd98 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:26:58.026469 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8f41b608-4823-4085-a192-4e23ef1afd98 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:26:58.026904 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8f41b608-4823-4085-a192-4e23ef1afd98 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:26:58.161195 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-8f41b608-4823-4085-a192-4e23ef1afd98 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af2fb64a6c4a4ea660196aa90a9c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd084bf56f7894fb98a46d7e2cbb34157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:26:58.168925 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-8f41b608-4823-4085-a192-4e23ef1afd98 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] 10.222.0.20 "GET /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c" status: 200 len: 1577 microversion: 2.1 time: 0.156025 Jul 22 11:26:58.169495 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 591/1161] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:26:58 2022] GET /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:26:59.187491 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-c61997ba-0da5-47a8-817b-5b709020e91f tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:26:59.188159 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-c61997ba-0da5-47a8-817b-5b709020e91f tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] [instance: 3e342bc0-ddb4-4b26-9d31-04210b39c81c] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:26:59.194992 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c61997ba-0da5-47a8-817b-5b709020e91f tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:26:59.195480 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c61997ba-0da5-47a8-817b-5b709020e91f tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:26:59.196286 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c61997ba-0da5-47a8-817b-5b709020e91f tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:26:59.196729 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c61997ba-0da5-47a8-817b-5b709020e91f tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:26:59.328845 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-c61997ba-0da5-47a8-817b-5b709020e91f tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af2fb64a6c4a4ea660196aa90a9c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd084bf56f7894fb98a46d7e2cbb34157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:26:59.339278 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-c61997ba-0da5-47a8-817b-5b709020e91f tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] 10.222.0.20 "GET /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c" status: 200 len: 1577 microversion: 2.1 time: 0.155990 Jul 22 11:26:59.339868 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 571/1162] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:26:59 2022] GET /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:27:00.357906 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-39bb2ff8-4d26-4ed9-8881-9b778f131650 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:27:00.359016 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-39bb2ff8-4d26-4ed9-8881-9b778f131650 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] [instance: 3e342bc0-ddb4-4b26-9d31-04210b39c81c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:27:00.365709 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-39bb2ff8-4d26-4ed9-8881-9b778f131650 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:27:00.366149 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-39bb2ff8-4d26-4ed9-8881-9b778f131650 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:27:00.366909 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-39bb2ff8-4d26-4ed9-8881-9b778f131650 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:27:00.367619 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-39bb2ff8-4d26-4ed9-8881-9b778f131650 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:27:00.525763 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-39bb2ff8-4d26-4ed9-8881-9b778f131650 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af2fb64a6c4a4ea660196aa90a9c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd084bf56f7894fb98a46d7e2cbb34157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:27:00.536122 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-39bb2ff8-4d26-4ed9-8881-9b778f131650 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] 10.222.0.20 "GET /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c" status: 200 len: 1564 microversion: 2.1 time: 0.181994 Jul 22 11:27:00.536800 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 592/1163] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:27:00 2022] GET /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c => generated 1564 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:27:03.096988 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [req-661a3e1f-1331-4a36-a2c2-db947d70065c req-de00f5cb-4998-4090-b1d0-f21082afb7c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e342bc0-ddb4-4b26-9d31-04210b39c81c", "name": "network-vif-plugged", "status": "completed", "tag": "05eda950-e6f4-4f38-86a7-bf112af47c3b"}]} {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:27:03.102220 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG dbcounter [-] [117884] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=117884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:27:03.106203 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-661a3e1f-1331-4a36-a2c2-db947d70065c req-de00f5cb-4998-4090-b1d0-f21082afb7c1 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:27:03.106644 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-661a3e1f-1331-4a36-a2c2-db947d70065c req-de00f5cb-4998-4090-b1d0-f21082afb7c1 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:27:03.121302 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.compute.server_external_events [req-661a3e1f-1331-4a36-a2c2-db947d70065c req-de00f5cb-4998-4090-b1d0-f21082afb7c1 service nova] Creating event network-vif-plugged:05eda950-e6f4-4f38-86a7-bf112af47c3b for instance 3e342bc0-ddb4-4b26-9d31-04210b39c81c on hv-cinder-84890 Jul 22 11:27:03.128905 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [req-661a3e1f-1331-4a36-a2c2-db947d70065c req-de00f5cb-4998-4090-b1d0-f21082afb7c1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037531 Jul 22 11:27:03.129321 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 572/1164] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:27:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:28:15.068530 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_api:SELECT=46 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:28:15.069353 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=22 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:28:15.071425 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG dbcounter [-] [117884] Writing DB stats nova_cell1:SELECT=24 {{(pid=117884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:28:15.072788 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG dbcounter [-] [117884] Writing DB stats nova_api:SELECT=1 {{(pid=117884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 22 11:28:15.074742 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-b0ada0ea-3674-454f-a717-56ab6f9d44e7 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:28:15.075341 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-b0ada0ea-3674-454f-a717-56ab6f9d44e7 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] [instance: b2829ff8-193e-4095-aec6-4abfe1c5e678] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:28:15.077569 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [req-b4c42186-f2fe-4243-b9f2-0b1f1635796e req-a64990f3-5c8b-4012-9a41-390578628c04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2829ff8-193e-4095-aec6-4abfe1c5e678", "tag": "2f8a2b4d-4aa6-4af7-b7eb-f82c735a2555"}]} {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:28:15.083765 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b0ada0ea-3674-454f-a717-56ab6f9d44e7 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:28:15.084273 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b0ada0ea-3674-454f-a717-56ab6f9d44e7 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:28:15.085050 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b0ada0ea-3674-454f-a717-56ab6f9d44e7 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:28:15.085487 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b0ada0ea-3674-454f-a717-56ab6f9d44e7 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:28:15.091893 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-b4c42186-f2fe-4243-b9f2-0b1f1635796e req-a64990f3-5c8b-4012-9a41-390578628c04 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:28:15.092696 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-b4c42186-f2fe-4243-b9f2-0b1f1635796e req-a64990f3-5c8b-4012-9a41-390578628c04 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:28:15.106936 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.compute.server_external_events [req-b4c42186-f2fe-4243-b9f2-0b1f1635796e req-a64990f3-5c8b-4012-9a41-390578628c04 service nova] Creating event network-changed:2f8a2b4d-4aa6-4af7-b7eb-f82c735a2555 for instance b2829ff8-193e-4095-aec6-4abfe1c5e678 on hv-cinder-84890 Jul 22 11:28:15.110542 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-b0ada0ea-3674-454f-a717-56ab6f9d44e7 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] [instance: b2829ff8-193e-4095-aec6-4abfe1c5e678] Going to try to terminate instance {{(pid=117885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 22 11:28:15.112301 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [req-b4c42186-f2fe-4243-b9f2-0b1f1635796e req-a64990f3-5c8b-4012-9a41-390578628c04 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043183 Jul 22 11:28:15.112951 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 573/1165] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:28:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:28:15.203629 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-b0ada0ea-3674-454f-a717-56ab6f9d44e7 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b2829ff8-193e-4095-aec6-4abfe1c5e678" status: 204 len: 0 microversion: 2.1 time: 0.137198 Jul 22 11:28:15.207998 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 593/1166] 10.222.0.20 () {58 vars in 1238 bytes} [Fri Jul 22 11:28:15 2022] DELETE /compute/v2.1/servers/b2829ff8-193e-4095-aec6-4abfe1c5e678 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 22 11:28:15.216164 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-edbb7341-d3e9-4dc5-8d49-7f494481cfcd tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:28:15.217283 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-edbb7341-d3e9-4dc5-8d49-7f494481cfcd tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] [instance: b2829ff8-193e-4095-aec6-4abfe1c5e678] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:28:15.226131 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-edbb7341-d3e9-4dc5-8d49-7f494481cfcd tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:28:15.226577 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-edbb7341-d3e9-4dc5-8d49-7f494481cfcd tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:28:15.227667 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-edbb7341-d3e9-4dc5-8d49-7f494481cfcd tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:28:15.228102 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-edbb7341-d3e9-4dc5-8d49-7f494481cfcd tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:28:15.373942 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-edbb7341-d3e9-4dc5-8d49-7f494481cfcd tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a299663b56b411b9fc910ddf47103e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d58bceb8414b02a1bbaec0db07d85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:28:15.382388 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-edbb7341-d3e9-4dc5-8d49-7f494481cfcd tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] 10.222.0.20 "GET /compute/v2.1/servers/b2829ff8-193e-4095-aec6-4abfe1c5e678" status: 200 len: 1577 microversion: 2.1 time: 0.171882 Jul 22 11:28:15.383051 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 574/1167] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:28:15 2022] GET /compute/v2.1/servers/b2829ff8-193e-4095-aec6-4abfe1c5e678 => generated 1577 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:28:16.401519 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-67b9124d-31e5-49e7-a98e-93a3af744ca3 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:28:16.402228 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-67b9124d-31e5-49e7-a98e-93a3af744ca3 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] [instance: b2829ff8-193e-4095-aec6-4abfe1c5e678] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:28:16.409270 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-67b9124d-31e5-49e7-a98e-93a3af744ca3 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:28:16.409719 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-67b9124d-31e5-49e7-a98e-93a3af744ca3 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:28:16.411248 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-67b9124d-31e5-49e7-a98e-93a3af744ca3 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:28:16.411712 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-67b9124d-31e5-49e7-a98e-93a3af744ca3 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:28:16.651173 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-67b9124d-31e5-49e7-a98e-93a3af744ca3 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a299663b56b411b9fc910ddf47103e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d58bceb8414b02a1bbaec0db07d85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:28:16.658821 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-67b9124d-31e5-49e7-a98e-93a3af744ca3 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] 10.222.0.20 "GET /compute/v2.1/servers/b2829ff8-193e-4095-aec6-4abfe1c5e678" status: 200 len: 1577 microversion: 2.1 time: 0.261540 Jul 22 11:28:16.659439 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 594/1168] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:28:16 2022] GET /compute/v2.1/servers/b2829ff8-193e-4095-aec6-4abfe1c5e678 => generated 1577 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:28:17.314192 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [req-a7e5d765-a396-4377-97c3-c596023f0c85 req-b9464564-f0bd-4282-859f-cc56caaa0a16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2829ff8-193e-4095-aec6-4abfe1c5e678", "name": "network-vif-deleted", "tag": "2f8a2b4d-4aa6-4af7-b7eb-f82c735a2555"}]} {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:28:17.323782 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-a7e5d765-a396-4377-97c3-c596023f0c85 req-b9464564-f0bd-4282-859f-cc56caaa0a16 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:28:17.324213 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-a7e5d765-a396-4377-97c3-c596023f0c85 req-b9464564-f0bd-4282-859f-cc56caaa0a16 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:28:17.337288 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.compute.server_external_events [req-a7e5d765-a396-4377-97c3-c596023f0c85 req-b9464564-f0bd-4282-859f-cc56caaa0a16 service nova] Creating event network-vif-deleted:2f8a2b4d-4aa6-4af7-b7eb-f82c735a2555 for instance b2829ff8-193e-4095-aec6-4abfe1c5e678 on hv-cinder-84890 Jul 22 11:28:17.342635 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [req-a7e5d765-a396-4377-97c3-c596023f0c85 req-b9464564-f0bd-4282-859f-cc56caaa0a16 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032046 Jul 22 11:28:17.343228 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 575/1169] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:28:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:28:17.677070 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-c931e89f-d8d6-43e2-90a9-911cbc7d9ec7 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:28:17.677711 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-c931e89f-d8d6-43e2-90a9-911cbc7d9ec7 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] [instance: b2829ff8-193e-4095-aec6-4abfe1c5e678] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:28:17.684527 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c931e89f-d8d6-43e2-90a9-911cbc7d9ec7 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:28:17.685265 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c931e89f-d8d6-43e2-90a9-911cbc7d9ec7 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:28:17.686059 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c931e89f-d8d6-43e2-90a9-911cbc7d9ec7 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:28:17.686501 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c931e89f-d8d6-43e2-90a9-911cbc7d9ec7 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:28:17.726297 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c931e89f-d8d6-43e2-90a9-911cbc7d9ec7 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:28:17.726818 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c931e89f-d8d6-43e2-90a9-911cbc7d9ec7 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:28:17.727384 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.objects.instance [None req-c931e89f-d8d6-43e2-90a9-911cbc7d9ec7 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lazy-loading 'fault' on Instance uuid b2829ff8-193e-4095-aec6-4abfe1c5e678 {{(pid=117885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 22 11:28:17.776481 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-c931e89f-d8d6-43e2-90a9-911cbc7d9ec7 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a299663b56b411b9fc910ddf47103e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d58bceb8414b02a1bbaec0db07d85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:28:17.784150 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-c931e89f-d8d6-43e2-90a9-911cbc7d9ec7 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] 10.222.0.20 "GET /compute/v2.1/servers/b2829ff8-193e-4095-aec6-4abfe1c5e678" status: 200 len: 1229 microversion: 2.1 time: 0.111604 Jul 22 11:28:17.784722 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 595/1170] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:28:17 2022] GET /compute/v2.1/servers/b2829ff8-193e-4095-aec6-4abfe1c5e678 => generated 1229 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:28:18.802942 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-33a343e9-bfbf-401f-8a79-f77ade333a87 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:28:18.803658 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-33a343e9-bfbf-401f-8a79-f77ade333a87 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] [instance: b2829ff8-193e-4095-aec6-4abfe1c5e678] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:28:18.809836 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-33a343e9-bfbf-401f-8a79-f77ade333a87 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:28:18.810285 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-33a343e9-bfbf-401f-8a79-f77ade333a87 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:28:18.811722 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-33a343e9-bfbf-401f-8a79-f77ade333a87 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:28:18.812166 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-33a343e9-bfbf-401f-8a79-f77ade333a87 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:28:18.826099 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.wsgi [None req-33a343e9-bfbf-401f-8a79-f77ade333a87 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] HTTP exception thrown: Instance b2829ff8-193e-4095-aec6-4abfe1c5e678 could not be found. Jul 22 11:28:18.827773 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-33a343e9-bfbf-401f-8a79-f77ade333a87 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Request method failure captured: Jul 22 11:28:18.827773 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: request: GET /compute/v2.1/servers/b2829ff8-193e-4095-aec6-4abfe1c5e678 HTTP/1.1 Jul 22 11:28:18.827773 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Accept: application/json Jul 22 11:28:18.827773 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Accept-Encoding: identity Jul 22 11:28:18.827773 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Connection: close Jul 22 11:28:18.827773 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Content-Length: 0 Jul 22 11:28:18.827773 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Content-Type: application/json Jul 22 11:28:18.827773 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Host: 10.222.0.20 Jul 22 11:28:18.827773 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Openstack-System-Scope: None Jul 22 11:28:18.827773 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: User-Agent: python-urllib3/1.26.9 Jul 22 11:28:18.827773 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Auth-Token: gAAAAABi2ogmjCFN35PTqtlSgpzQ3l-UABdR039uflNNLPXRj34zwogXxHD0YrMhGDqkpC-lSYaWWXD9Ourj5sd0cDYhOo4wH_3Zbrg-XP_OtyRG6zW9e4tlfhNmHiuhlX2-eN9xtNmSRwHt3dkRVw7OBbkq9qvey7w3mJqVlifrSPb4U_5pqqg Jul 22 11:28:18.827773 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Domain-Id: None Jul 22 11:28:18.827773 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Domain-Name: None Jul 22 11:28:18.827773 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Identity-Status: Confirmed Jul 22 11:28:18.827773 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Is-Admin-Project: True Jul 22 11:28:18.827773 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Domain-Id: default Jul 22 11:28:18.827773 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Domain-Name: Default Jul 22 11:28:18.827773 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Id: 04d58bceb8414b02a1bbaec0db07d85e Jul 22 11:28:18.827773 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Name: tempest-TestVolumeBootPattern-945725022 Jul 22 11:28:18.827773 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Role: reader,member Jul 22 11:28:18.827773 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Roles: reader,member Jul 22 11:28:18.829438 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/04d58bceb8414b02a1bbaec0db07d85e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_04d58bceb8414b02a1bbaec0db07d85e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/04d58bceb8414b02a1bbaec0db07d85e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/04d58bceb8414b02a1bbaec0db07d85e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jul 22 11:28:18.829438 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant: tempest-TestVolumeBootPattern-945725022 Jul 22 11:28:18.829438 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant-Id: 04d58bceb8414b02a1bbaec0db07d85e Jul 22 11:28:18.829438 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant-Name: tempest-TestVolumeBootPattern-945725022 Jul 22 11:28:18.829438 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User: tempest-TestVolumeBootPattern-945725022-project Jul 22 11:28:18.829438 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Domain-Id: default Jul 22 11:28:18.829438 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Domain-Name: Default Jul 22 11:28:18.829438 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Id: 1a299663b56b411b9fc910ddf47103e5 Jul 22 11:28:18.829438 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Name: tempest-TestVolumeBootPattern-945725022-project Jul 22 11:28:18.829438 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: method: > Jul 22 11:28:18.829438 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: exception: Instance b2829ff8-193e-4095-aec6-4abfe1c5e678 could not be found. Jul 22 11:28:18.829438 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: action_args: {'id': 'b2829ff8-193e-4095-aec6-4abfe1c5e678'} Jul 22 11:28:18.830327 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 22 11:28:18.830327 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:28:18.830327 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 22 11:28:18.830327 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 22 11:28:18.830327 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 22 11:28:18.830327 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 22 11:28:18.830327 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 22 11:28:18.830327 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 22 11:28:18.830327 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 22 11:28:18.830327 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 22 11:28:18.830327 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2829ff8-193e-4095-aec6-4abfe1c5e678 could not be found. Jul 22 11:28:18.830327 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:28:18.830327 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:28:18.830327 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:28:18.830327 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:28:18.830327 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:28:18.830327 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:28:18.830327 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 22 11:28:18.830327 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 22 11:28:18.830327 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 22 11:28:18.832025 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 22 11:28:18.832025 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 22 11:28:18.832025 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 22 11:28:18.832025 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 22 11:28:18.832025 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 22 11:28:18.832025 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 22 11:28:18.832025 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 22 11:28:18.832025 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2829ff8-193e-4095-aec6-4abfe1c5e678 could not be found. Jul 22 11:28:18.832025 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:28:18.832025 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:28:18.832025 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:28:18.832025 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:28:18.832025 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:28:18.832025 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:28:18.832025 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 22 11:28:18.832025 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 22 11:28:18.832025 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2829ff8-193e-4095-aec6-4abfe1c5e678 could not be found. Jul 22 11:28:18.832025 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:28:18.834380 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-33a343e9-bfbf-401f-8a79-f77ade333a87 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Returning 404 to user: Instance b2829ff8-193e-4095-aec6-4abfe1c5e678 could not be found. {{(pid=117884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 22 11:28:18.834380 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-33a343e9-bfbf-401f-8a79-f77ade333a87 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] 10.222.0.20 "GET /compute/v2.1/servers/b2829ff8-193e-4095-aec6-4abfe1c5e678" status: 404 len: 111 microversion: 2.1 time: 0.030927 Jul 22 11:28:18.834380 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 576/1171] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:28:18 2022] GET /compute/v2.1/servers/b2829ff8-193e-4095-aec6-4abfe1c5e678 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 22 11:28:19.680897 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-e58147c8-ded3-4ba3-bfb0-e385988ab126 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:28:19.681550 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-e58147c8-ded3-4ba3-bfb0-e385988ab126 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] [instance: 3e342bc0-ddb4-4b26-9d31-04210b39c81c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:28:19.683292 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [req-f958d634-855a-4053-89ba-5f87f66b0667 req-a13f4ba5-25f1-4089-88fe-f7834a395e77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e342bc0-ddb4-4b26-9d31-04210b39c81c", "tag": "05eda950-e6f4-4f38-86a7-bf112af47c3b"}]} {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:28:19.688289 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e58147c8-ded3-4ba3-bfb0-e385988ab126 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:28:19.688744 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e58147c8-ded3-4ba3-bfb0-e385988ab126 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:28:19.689518 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e58147c8-ded3-4ba3-bfb0-e385988ab126 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:28:19.690139 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e58147c8-ded3-4ba3-bfb0-e385988ab126 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:28:19.694309 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-f958d634-855a-4053-89ba-5f87f66b0667 req-a13f4ba5-25f1-4089-88fe-f7834a395e77 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:28:19.695019 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-f958d634-855a-4053-89ba-5f87f66b0667 req-a13f4ba5-25f1-4089-88fe-f7834a395e77 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:28:19.706660 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.compute.server_external_events [req-f958d634-855a-4053-89ba-5f87f66b0667 req-a13f4ba5-25f1-4089-88fe-f7834a395e77 service nova] Creating event network-changed:05eda950-e6f4-4f38-86a7-bf112af47c3b for instance 3e342bc0-ddb4-4b26-9d31-04210b39c81c on hv-cinder-84890 Jul 22 11:28:19.713252 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [req-f958d634-855a-4053-89ba-5f87f66b0667 req-a13f4ba5-25f1-4089-88fe-f7834a395e77 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033618 Jul 22 11:28:19.714156 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 577/1172] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:28:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:28:19.720479 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-e58147c8-ded3-4ba3-bfb0-e385988ab126 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] [instance: 3e342bc0-ddb4-4b26-9d31-04210b39c81c] Going to try to terminate instance {{(pid=117885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 22 11:28:19.809990 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-e58147c8-ded3-4ba3-bfb0-e385988ab126 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c" status: 204 len: 0 microversion: 2.1 time: 0.132560 Jul 22 11:28:19.815359 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 596/1173] 10.222.0.20 () {58 vars in 1238 bytes} [Fri Jul 22 11:28:19 2022] DELETE /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 22 11:28:19.820287 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-54c54900-ff67-4233-883c-996095bda990 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:28:19.821705 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-54c54900-ff67-4233-883c-996095bda990 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] [instance: 3e342bc0-ddb4-4b26-9d31-04210b39c81c] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:28:19.828914 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-54c54900-ff67-4233-883c-996095bda990 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:28:19.829460 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-54c54900-ff67-4233-883c-996095bda990 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:28:19.830488 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-54c54900-ff67-4233-883c-996095bda990 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:28:19.831034 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-54c54900-ff67-4233-883c-996095bda990 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:28:19.993114 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-54c54900-ff67-4233-883c-996095bda990 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af2fb64a6c4a4ea660196aa90a9c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd084bf56f7894fb98a46d7e2cbb34157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:28:20.001740 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-54c54900-ff67-4233-883c-996095bda990 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] 10.222.0.20 "GET /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c" status: 200 len: 1570 microversion: 2.1 time: 0.186384 Jul 22 11:28:20.002597 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 578/1174] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:28:19 2022] GET /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c => generated 1570 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:28:21.021606 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-e4c53542-a431-46dd-9591-c3f52447a1b9 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:28:21.022201 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-e4c53542-a431-46dd-9591-c3f52447a1b9 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] [instance: 3e342bc0-ddb4-4b26-9d31-04210b39c81c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:28:21.028706 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e4c53542-a431-46dd-9591-c3f52447a1b9 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:28:21.029157 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e4c53542-a431-46dd-9591-c3f52447a1b9 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:28:21.029929 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e4c53542-a431-46dd-9591-c3f52447a1b9 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:28:21.030371 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e4c53542-a431-46dd-9591-c3f52447a1b9 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:28:21.200041 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-e4c53542-a431-46dd-9591-c3f52447a1b9 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af2fb64a6c4a4ea660196aa90a9c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd084bf56f7894fb98a46d7e2cbb34157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:28:21.210990 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-e4c53542-a431-46dd-9591-c3f52447a1b9 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] 10.222.0.20 "GET /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c" status: 200 len: 1570 microversion: 2.1 time: 0.193529 Jul 22 11:28:21.212893 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 597/1175] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:28:21 2022] GET /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c => generated 1570 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:28:22.056489 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [req-300d29b0-5c80-4d0f-aafe-b4e0e9bf0118 req-4ac57f77-7ebe-4ffe-91f4-0c672f438d6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e342bc0-ddb4-4b26-9d31-04210b39c81c", "name": "network-vif-deleted", "tag": "05eda950-e6f4-4f38-86a7-bf112af47c3b"}]} {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:28:22.067009 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-300d29b0-5c80-4d0f-aafe-b4e0e9bf0118 req-4ac57f77-7ebe-4ffe-91f4-0c672f438d6c service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:28:22.068062 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-300d29b0-5c80-4d0f-aafe-b4e0e9bf0118 req-4ac57f77-7ebe-4ffe-91f4-0c672f438d6c service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:28:22.082408 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.compute.server_external_events [req-300d29b0-5c80-4d0f-aafe-b4e0e9bf0118 req-4ac57f77-7ebe-4ffe-91f4-0c672f438d6c service nova] Creating event network-vif-deleted:05eda950-e6f4-4f38-86a7-bf112af47c3b for instance 3e342bc0-ddb4-4b26-9d31-04210b39c81c on hv-cinder-84890 Jul 22 11:28:22.087633 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [req-300d29b0-5c80-4d0f-aafe-b4e0e9bf0118 req-4ac57f77-7ebe-4ffe-91f4-0c672f438d6c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102588 Jul 22 11:28:22.088251 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 579/1176] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:28:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:28:22.231341 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-f5479f98-ab76-4a41-bc2c-f79ad5c943b9 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:28:22.232038 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-f5479f98-ab76-4a41-bc2c-f79ad5c943b9 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] [instance: 3e342bc0-ddb4-4b26-9d31-04210b39c81c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:28:22.239686 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f5479f98-ab76-4a41-bc2c-f79ad5c943b9 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:28:22.240138 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f5479f98-ab76-4a41-bc2c-f79ad5c943b9 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:28:22.240915 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f5479f98-ab76-4a41-bc2c-f79ad5c943b9 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:28:22.241351 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f5479f98-ab76-4a41-bc2c-f79ad5c943b9 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:28:22.328157 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-f5479f98-ab76-4a41-bc2c-f79ad5c943b9 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af2fb64a6c4a4ea660196aa90a9c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd084bf56f7894fb98a46d7e2cbb34157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:28:22.338952 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-f5479f98-ab76-4a41-bc2c-f79ad5c943b9 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] 10.222.0.20 "GET /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c" status: 200 len: 1220 microversion: 2.1 time: 0.111580 Jul 22 11:28:22.339982 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 598/1177] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:28:22 2022] GET /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c => generated 1220 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:28:22.519150 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-dde1c0a9-74db-45c6-ad8d-d42ad04dd2ad req-ac32cebf-4af2-42af-a9e4-9049588e2b56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03c80c2f-d64d-4b77-86f6-81f65e6752aa", "tag": "546116d2-e38d-4e95-afb2-bdaec2cf68f5"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:28:22.523293 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-73976e8a-6b14-4232-8e7e-c64f5cd1ed0c tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:28:22.523914 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-73976e8a-6b14-4232-8e7e-c64f5cd1ed0c tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] [instance: 03c80c2f-d64d-4b77-86f6-81f65e6752aa] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:28:22.529633 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-dde1c0a9-74db-45c6-ad8d-d42ad04dd2ad req-ac32cebf-4af2-42af-a9e4-9049588e2b56 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:28:22.530436 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-dde1c0a9-74db-45c6-ad8d-d42ad04dd2ad req-ac32cebf-4af2-42af-a9e4-9049588e2b56 service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:28:22.534270 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-73976e8a-6b14-4232-8e7e-c64f5cd1ed0c tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:28:22.536761 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-73976e8a-6b14-4232-8e7e-c64f5cd1ed0c tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:28:22.536761 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-73976e8a-6b14-4232-8e7e-c64f5cd1ed0c tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:28:22.537883 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-73976e8a-6b14-4232-8e7e-c64f5cd1ed0c tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:28:22.545800 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-dde1c0a9-74db-45c6-ad8d-d42ad04dd2ad req-ac32cebf-4af2-42af-a9e4-9049588e2b56 service nova] Creating event network-changed:546116d2-e38d-4e95-afb2-bdaec2cf68f5 for instance 03c80c2f-d64d-4b77-86f6-81f65e6752aa on hv-cinder-84890 Jul 22 11:28:22.554198 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-dde1c0a9-74db-45c6-ad8d-d42ad04dd2ad req-ac32cebf-4af2-42af-a9e4-9049588e2b56 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040805 Jul 22 11:28:22.555221 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 599/1178] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:28:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:28:22.571093 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-73976e8a-6b14-4232-8e7e-c64f5cd1ed0c tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] [instance: 03c80c2f-d64d-4b77-86f6-81f65e6752aa] Going to try to terminate instance {{(pid=117884) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 22 11:28:22.681688 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-73976e8a-6b14-4232-8e7e-c64f5cd1ed0c tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] 10.222.0.20 "DELETE /compute/v2.1/servers/03c80c2f-d64d-4b77-86f6-81f65e6752aa" status: 204 len: 0 microversion: 2.1 time: 0.171710 Jul 22 11:28:22.682314 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 580/1179] 10.222.0.20 () {58 vars in 1238 bytes} [Fri Jul 22 11:28:22 2022] DELETE /compute/v2.1/servers/03c80c2f-d64d-4b77-86f6-81f65e6752aa => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 22 11:28:22.691286 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-05c1b74f-9cf5-4fe4-97ae-12ab1bd92743 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:28:22.692084 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-05c1b74f-9cf5-4fe4-97ae-12ab1bd92743 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] [instance: 03c80c2f-d64d-4b77-86f6-81f65e6752aa] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:28:22.698882 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-05c1b74f-9cf5-4fe4-97ae-12ab1bd92743 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:28:22.699397 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-05c1b74f-9cf5-4fe4-97ae-12ab1bd92743 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:28:22.700186 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-05c1b74f-9cf5-4fe4-97ae-12ab1bd92743 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:28:22.700624 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-05c1b74f-9cf5-4fe4-97ae-12ab1bd92743 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:28:22.859467 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-05c1b74f-9cf5-4fe4-97ae-12ab1bd92743 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a299663b56b411b9fc910ddf47103e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d58bceb8414b02a1bbaec0db07d85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:28:22.873822 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-05c1b74f-9cf5-4fe4-97ae-12ab1bd92743 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] 10.222.0.20 "GET /compute/v2.1/servers/03c80c2f-d64d-4b77-86f6-81f65e6752aa" status: 200 len: 1579 microversion: 2.1 time: 0.186717 Jul 22 11:28:22.874504 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 600/1180] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:28:22 2022] GET /compute/v2.1/servers/03c80c2f-d64d-4b77-86f6-81f65e6752aa => generated 1579 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:28:23.358652 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-4469bac8-7ed3-458d-95f7-6e9745031685 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:28:23.359440 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-4469bac8-7ed3-458d-95f7-6e9745031685 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] [instance: 3e342bc0-ddb4-4b26-9d31-04210b39c81c] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:28:23.366118 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-4469bac8-7ed3-458d-95f7-6e9745031685 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:28:23.366556 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-4469bac8-7ed3-458d-95f7-6e9745031685 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:28:23.367608 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-4469bac8-7ed3-458d-95f7-6e9745031685 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:28:23.367837 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-4469bac8-7ed3-458d-95f7-6e9745031685 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:28:23.404834 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-4469bac8-7ed3-458d-95f7-6e9745031685 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:28:23.405276 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-4469bac8-7ed3-458d-95f7-6e9745031685 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:28:23.405723 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.objects.instance [None req-4469bac8-7ed3-458d-95f7-6e9745031685 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lazy-loading 'fault' on Instance uuid 3e342bc0-ddb4-4b26-9d31-04210b39c81c {{(pid=117884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 22 11:28:23.449233 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.policy [None req-4469bac8-7ed3-458d-95f7-6e9745031685 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af2fb64a6c4a4ea660196aa90a9c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd084bf56f7894fb98a46d7e2cbb34157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117884) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:28:23.457934 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-4469bac8-7ed3-458d-95f7-6e9745031685 tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] 10.222.0.20 "GET /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c" status: 200 len: 1225 microversion: 2.1 time: 0.103300 Jul 22 11:28:23.458520 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 581/1181] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:28:23 2022] GET /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c => generated 1225 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:28:23.898617 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-33d12631-33f6-42aa-8544-94a1900aec79 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:28:23.899662 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-33d12631-33f6-42aa-8544-94a1900aec79 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] [instance: 03c80c2f-d64d-4b77-86f6-81f65e6752aa] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:28:23.906391 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-33d12631-33f6-42aa-8544-94a1900aec79 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:28:23.906919 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-33d12631-33f6-42aa-8544-94a1900aec79 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:28:23.907643 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-33d12631-33f6-42aa-8544-94a1900aec79 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:28:23.908070 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-33d12631-33f6-42aa-8544-94a1900aec79 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:28:24.120533 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-33d12631-33f6-42aa-8544-94a1900aec79 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a299663b56b411b9fc910ddf47103e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d58bceb8414b02a1bbaec0db07d85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:28:24.132643 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-33d12631-33f6-42aa-8544-94a1900aec79 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] 10.222.0.20 "GET /compute/v2.1/servers/03c80c2f-d64d-4b77-86f6-81f65e6752aa" status: 200 len: 1579 microversion: 2.1 time: 0.237946 Jul 22 11:28:24.133904 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 601/1182] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:28:23 2022] GET /compute/v2.1/servers/03c80c2f-d64d-4b77-86f6-81f65e6752aa => generated 1579 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:28:24.476393 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-520b6d40-01fe-47b8-8d6e-70026ce5ab3f tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:28:24.477004 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-520b6d40-01fe-47b8-8d6e-70026ce5ab3f tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] [instance: 3e342bc0-ddb4-4b26-9d31-04210b39c81c] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:28:24.483372 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-520b6d40-01fe-47b8-8d6e-70026ce5ab3f tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:28:24.483822 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-520b6d40-01fe-47b8-8d6e-70026ce5ab3f tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:28:24.484593 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-520b6d40-01fe-47b8-8d6e-70026ce5ab3f tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:28:24.485034 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-520b6d40-01fe-47b8-8d6e-70026ce5ab3f tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:28:24.499235 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.wsgi [None req-520b6d40-01fe-47b8-8d6e-70026ce5ab3f tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] HTTP exception thrown: Instance 3e342bc0-ddb4-4b26-9d31-04210b39c81c could not be found. Jul 22 11:28:24.500935 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-520b6d40-01fe-47b8-8d6e-70026ce5ab3f tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Request method failure captured: Jul 22 11:28:24.500935 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: request: GET /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c HTTP/1.1 Jul 22 11:28:24.500935 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Accept: application/json Jul 22 11:28:24.500935 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Accept-Encoding: identity Jul 22 11:28:24.500935 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Connection: close Jul 22 11:28:24.500935 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Content-Length: 0 Jul 22 11:28:24.500935 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Content-Type: application/json Jul 22 11:28:24.500935 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Host: 10.222.0.20 Jul 22 11:28:24.500935 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Openstack-System-Scope: None Jul 22 11:28:24.500935 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: User-Agent: python-urllib3/1.26.9 Jul 22 11:28:24.500935 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Auth-Token: gAAAAABi2oi2XRjCXMIuPTbamEP344bAVB15pPBdnw5dMdtB-0JutgsCO58vU7dRObpT-kJsfst2gC03TC_x0F-qSGAEVzxgJuJjLw7ZVRbsQPKXvtEWnWSSH8t3VP8jzTrv3i6kzkf9663zJ2rKlZvdGsVUl3kJTMQ5M_e26baa3wIZxLwybW8 Jul 22 11:28:24.500935 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Domain-Id: None Jul 22 11:28:24.500935 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Domain-Name: None Jul 22 11:28:24.500935 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Identity-Status: Confirmed Jul 22 11:28:24.500935 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Is-Admin-Project: True Jul 22 11:28:24.500935 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Domain-Id: default Jul 22 11:28:24.500935 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Domain-Name: Default Jul 22 11:28:24.500935 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Id: d084bf56f7894fb98a46d7e2cbb34157 Jul 22 11:28:24.500935 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Name: tempest-TestShelveInstance-528753580 Jul 22 11:28:24.500935 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Role: reader,member Jul 22 11:28:24.500935 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Roles: reader,member Jul 22 11:28:24.502743 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d084bf56f7894fb98a46d7e2cbb34157"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d084bf56f7894fb98a46d7e2cbb34157", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d084bf56f7894fb98a46d7e2cbb34157"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d084bf56f7894fb98a46d7e2cbb34157"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jul 22 11:28:24.502743 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant: tempest-TestShelveInstance-528753580 Jul 22 11:28:24.502743 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant-Id: d084bf56f7894fb98a46d7e2cbb34157 Jul 22 11:28:24.502743 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant-Name: tempest-TestShelveInstance-528753580 Jul 22 11:28:24.502743 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User: tempest-TestShelveInstance-528753580-project Jul 22 11:28:24.502743 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Domain-Id: default Jul 22 11:28:24.502743 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Domain-Name: Default Jul 22 11:28:24.502743 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Id: 11af2fb64a6c4a4ea660196aa90a9c9e Jul 22 11:28:24.502743 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Name: tempest-TestShelveInstance-528753580-project Jul 22 11:28:24.502743 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: method: > Jul 22 11:28:24.502743 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: exception: Instance 3e342bc0-ddb4-4b26-9d31-04210b39c81c could not be found. Jul 22 11:28:24.502743 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: action_args: {'id': '3e342bc0-ddb4-4b26-9d31-04210b39c81c'} Jul 22 11:28:24.503919 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 22 11:28:24.503919 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:28:24.503919 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 22 11:28:24.503919 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 22 11:28:24.503919 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 22 11:28:24.503919 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 22 11:28:24.503919 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 22 11:28:24.503919 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 22 11:28:24.503919 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 22 11:28:24.503919 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 22 11:28:24.503919 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e342bc0-ddb4-4b26-9d31-04210b39c81c could not be found. Jul 22 11:28:24.503919 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:28:24.503919 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:28:24.503919 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:28:24.503919 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:28:24.503919 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:28:24.503919 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:28:24.503919 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 22 11:28:24.503919 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 22 11:28:24.503919 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 22 11:28:24.505511 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 22 11:28:24.505511 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 22 11:28:24.505511 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 22 11:28:24.505511 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 22 11:28:24.505511 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 22 11:28:24.505511 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 22 11:28:24.505511 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 22 11:28:24.505511 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e342bc0-ddb4-4b26-9d31-04210b39c81c could not be found. Jul 22 11:28:24.505511 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:28:24.505511 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:28:24.505511 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:28:24.505511 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:28:24.505511 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:28:24.505511 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:28:24.505511 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 22 11:28:24.505511 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 22 11:28:24.505511 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e342bc0-ddb4-4b26-9d31-04210b39c81c could not be found. Jul 22 11:28:24.505511 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:28:24.507458 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-520b6d40-01fe-47b8-8d6e-70026ce5ab3f tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Returning 404 to user: Instance 3e342bc0-ddb4-4b26-9d31-04210b39c81c could not be found. {{(pid=117884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 22 11:28:24.507458 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-520b6d40-01fe-47b8-8d6e-70026ce5ab3f tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] 10.222.0.20 "GET /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c" status: 404 len: 111 microversion: 2.1 time: 0.030779 Jul 22 11:28:24.507458 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 582/1183] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:28:24 2022] GET /compute/v2.1/servers/3e342bc0-ddb4-4b26-9d31-04210b39c81c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 22 11:28:24.678577 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-7034f752-2245-4cf5-bda0-9a222aca0b5b tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] Calling method '.version_select at 0x7f844985fa60>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:28:24.719620 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-7034f752-2245-4cf5-bda0-9a222aca0b5b tempest-TestShelveInstance-528753580 tempest-TestShelveInstance-528753580-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1543274439" status: 202 len: 0 microversion: 2.1 time: 0.045288 Jul 22 11:28:24.720352 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 602/1184] 10.222.0.20 () {58 vars in 1253 bytes} [Fri Jul 22 11:28:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1543274439 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 22 11:28:25.023347 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [req-7eed792f-c979-40fb-bd4e-1d0c560ad741 req-034d01c5-f95e-429d-aca4-489c39b3928e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03c80c2f-d64d-4b77-86f6-81f65e6752aa", "name": "network-vif-deleted", "tag": "546116d2-e38d-4e95-afb2-bdaec2cf68f5"}]} {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 11:28:25.032609 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-7eed792f-c979-40fb-bd4e-1d0c560ad741 req-034d01c5-f95e-429d-aca4-489c39b3928e service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:28:25.033048 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [req-7eed792f-c979-40fb-bd4e-1d0c560ad741 req-034d01c5-f95e-429d-aca4-489c39b3928e service nova] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:28:25.045531 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.compute.server_external_events [req-7eed792f-c979-40fb-bd4e-1d0c560ad741 req-034d01c5-f95e-429d-aca4-489c39b3928e service nova] Creating event network-vif-deleted:546116d2-e38d-4e95-afb2-bdaec2cf68f5 for instance 03c80c2f-d64d-4b77-86f6-81f65e6752aa on hv-cinder-84890 Jul 22 11:28:25.052342 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [req-7eed792f-c979-40fb-bd4e-1d0c560ad741 req-034d01c5-f95e-429d-aca4-489c39b3928e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032702 Jul 22 11:28:25.053817 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 583/1185] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Jul 22 11:28:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 11:28:25.151011 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-3389bafc-14de-4258-8673-7babdb9312dd tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:28:25.151824 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-3389bafc-14de-4258-8673-7babdb9312dd tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] [instance: 03c80c2f-d64d-4b77-86f6-81f65e6752aa] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:28:25.157944 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3389bafc-14de-4258-8673-7babdb9312dd tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:28:25.158384 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3389bafc-14de-4258-8673-7babdb9312dd tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:28:25.159236 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3389bafc-14de-4258-8673-7babdb9312dd tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:28:25.159713 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3389bafc-14de-4258-8673-7babdb9312dd tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:28:25.262911 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-3389bafc-14de-4258-8673-7babdb9312dd tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a299663b56b411b9fc910ddf47103e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d58bceb8414b02a1bbaec0db07d85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 11:28:25.270606 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-3389bafc-14de-4258-8673-7babdb9312dd tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] 10.222.0.20 "GET /compute/v2.1/servers/03c80c2f-d64d-4b77-86f6-81f65e6752aa" status: 200 len: 1225 microversion: 2.1 time: 0.124131 Jul 22 11:28:25.271409 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 603/1186] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:28:25 2022] GET /compute/v2.1/servers/03c80c2f-d64d-4b77-86f6-81f65e6752aa => generated 1225 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 11:28:26.288338 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-c29de82f-202d-45a8-a0c9-62dee76343f3 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:28:26.289043 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-c29de82f-202d-45a8-a0c9-62dee76343f3 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] [instance: 03c80c2f-d64d-4b77-86f6-81f65e6752aa] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:28:26.295626 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c29de82f-202d-45a8-a0c9-62dee76343f3 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:28:26.296086 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c29de82f-202d-45a8-a0c9-62dee76343f3 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:28:26.296865 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c29de82f-202d-45a8-a0c9-62dee76343f3 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:28:26.297287 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c29de82f-202d-45a8-a0c9-62dee76343f3 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:28:26.312060 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.wsgi [None req-c29de82f-202d-45a8-a0c9-62dee76343f3 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] HTTP exception thrown: Instance 03c80c2f-d64d-4b77-86f6-81f65e6752aa could not be found. Jul 22 11:28:26.313735 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-c29de82f-202d-45a8-a0c9-62dee76343f3 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Request method failure captured: Jul 22 11:28:26.313735 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: request: GET /compute/v2.1/servers/03c80c2f-d64d-4b77-86f6-81f65e6752aa HTTP/1.1 Jul 22 11:28:26.313735 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Accept: application/json Jul 22 11:28:26.313735 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Accept-Encoding: identity Jul 22 11:28:26.313735 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Connection: close Jul 22 11:28:26.313735 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Content-Length: 0 Jul 22 11:28:26.313735 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Content-Type: application/json Jul 22 11:28:26.313735 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Host: 10.222.0.20 Jul 22 11:28:26.313735 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Openstack-System-Scope: None Jul 22 11:28:26.313735 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: User-Agent: python-urllib3/1.26.9 Jul 22 11:28:26.313735 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Auth-Token: gAAAAABi2ogmjCFN35PTqtlSgpzQ3l-UABdR039uflNNLPXRj34zwogXxHD0YrMhGDqkpC-lSYaWWXD9Ourj5sd0cDYhOo4wH_3Zbrg-XP_OtyRG6zW9e4tlfhNmHiuhlX2-eN9xtNmSRwHt3dkRVw7OBbkq9qvey7w3mJqVlifrSPb4U_5pqqg Jul 22 11:28:26.313735 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Domain-Id: None Jul 22 11:28:26.313735 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Domain-Name: None Jul 22 11:28:26.313735 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Identity-Status: Confirmed Jul 22 11:28:26.313735 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Is-Admin-Project: True Jul 22 11:28:26.313735 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Domain-Id: default Jul 22 11:28:26.313735 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Domain-Name: Default Jul 22 11:28:26.313735 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Id: 04d58bceb8414b02a1bbaec0db07d85e Jul 22 11:28:26.313735 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Name: tempest-TestVolumeBootPattern-945725022 Jul 22 11:28:26.313735 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Role: reader,member Jul 22 11:28:26.313735 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Roles: reader,member Jul 22 11:28:26.315485 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/04d58bceb8414b02a1bbaec0db07d85e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_04d58bceb8414b02a1bbaec0db07d85e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/04d58bceb8414b02a1bbaec0db07d85e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/04d58bceb8414b02a1bbaec0db07d85e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jul 22 11:28:26.315485 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant: tempest-TestVolumeBootPattern-945725022 Jul 22 11:28:26.315485 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant-Id: 04d58bceb8414b02a1bbaec0db07d85e Jul 22 11:28:26.315485 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant-Name: tempest-TestVolumeBootPattern-945725022 Jul 22 11:28:26.315485 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User: tempest-TestVolumeBootPattern-945725022-project Jul 22 11:28:26.315485 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Domain-Id: default Jul 22 11:28:26.315485 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Domain-Name: Default Jul 22 11:28:26.315485 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Id: 1a299663b56b411b9fc910ddf47103e5 Jul 22 11:28:26.315485 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Name: tempest-TestVolumeBootPattern-945725022-project Jul 22 11:28:26.315485 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: method: > Jul 22 11:28:26.315485 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: exception: Instance 03c80c2f-d64d-4b77-86f6-81f65e6752aa could not be found. Jul 22 11:28:26.315485 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: action_args: {'id': '03c80c2f-d64d-4b77-86f6-81f65e6752aa'} Jul 22 11:28:26.316972 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 22 11:28:26.316972 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:28:26.316972 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 22 11:28:26.316972 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 22 11:28:26.316972 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 22 11:28:26.316972 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 22 11:28:26.316972 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 22 11:28:26.316972 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 22 11:28:26.316972 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 22 11:28:26.316972 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 22 11:28:26.316972 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03c80c2f-d64d-4b77-86f6-81f65e6752aa could not be found. Jul 22 11:28:26.316972 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:28:26.316972 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:28:26.316972 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:28:26.316972 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:28:26.316972 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:28:26.316972 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:28:26.316972 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 22 11:28:26.316972 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 22 11:28:26.316972 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 22 11:28:26.318552 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 22 11:28:26.318552 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 22 11:28:26.318552 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 22 11:28:26.318552 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 22 11:28:26.318552 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 22 11:28:26.318552 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 22 11:28:26.318552 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 22 11:28:26.318552 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03c80c2f-d64d-4b77-86f6-81f65e6752aa could not be found. Jul 22 11:28:26.318552 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:28:26.318552 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:28:26.318552 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:28:26.318552 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:28:26.318552 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:28:26.318552 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:28:26.318552 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 22 11:28:26.318552 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 22 11:28:26.318552 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03c80c2f-d64d-4b77-86f6-81f65e6752aa could not be found. Jul 22 11:28:26.318552 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:28:26.320041 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-c29de82f-202d-45a8-a0c9-62dee76343f3 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Returning 404 to user: Instance 03c80c2f-d64d-4b77-86f6-81f65e6752aa could not be found. {{(pid=117884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 22 11:28:26.320041 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-c29de82f-202d-45a8-a0c9-62dee76343f3 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] 10.222.0.20 "GET /compute/v2.1/servers/03c80c2f-d64d-4b77-86f6-81f65e6752aa" status: 404 len: 111 microversion: 2.1 time: 0.031778 Jul 22 11:28:26.320041 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 584/1187] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:28:26 2022] GET /compute/v2.1/servers/03c80c2f-d64d-4b77-86f6-81f65e6752aa => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 22 11:28:26.810064 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-16c365e3-4d30-47b9-9565-88e0cb620e8c tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:28:26.811319 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-16c365e3-4d30-47b9-9565-88e0cb620e8c tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] [instance: 36dec2db-4166-4853-a79b-832ad7fc2730] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:28:26.818151 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-16c365e3-4d30-47b9-9565-88e0cb620e8c tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:28:26.818724 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-16c365e3-4d30-47b9-9565-88e0cb620e8c tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:28:26.819636 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-16c365e3-4d30-47b9-9565-88e0cb620e8c tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:28:26.820172 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-16c365e3-4d30-47b9-9565-88e0cb620e8c tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:28:26.834917 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.wsgi [None req-16c365e3-4d30-47b9-9565-88e0cb620e8c tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] HTTP exception thrown: Instance 36dec2db-4166-4853-a79b-832ad7fc2730 could not be found. Jul 22 11:28:26.836815 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-16c365e3-4d30-47b9-9565-88e0cb620e8c tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Request method failure captured: Jul 22 11:28:26.836815 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: request: DELETE /compute/v2.1/servers/36dec2db-4166-4853-a79b-832ad7fc2730 HTTP/1.1 Jul 22 11:28:26.836815 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Accept: application/json Jul 22 11:28:26.836815 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Accept-Encoding: identity Jul 22 11:28:26.836815 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Connection: close Jul 22 11:28:26.836815 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Content-Length: 0 Jul 22 11:28:26.836815 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Content-Type: application/json Jul 22 11:28:26.836815 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Host: 10.222.0.20 Jul 22 11:28:26.836815 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Openstack-System-Scope: None Jul 22 11:28:26.836815 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: User-Agent: python-urllib3/1.26.9 Jul 22 11:28:26.836815 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Auth-Token: gAAAAABi2ogmjCFN35PTqtlSgpzQ3l-UABdR039uflNNLPXRj34zwogXxHD0YrMhGDqkpC-lSYaWWXD9Ourj5sd0cDYhOo4wH_3Zbrg-XP_OtyRG6zW9e4tlfhNmHiuhlX2-eN9xtNmSRwHt3dkRVw7OBbkq9qvey7w3mJqVlifrSPb4U_5pqqg Jul 22 11:28:26.836815 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Domain-Id: None Jul 22 11:28:26.836815 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Domain-Name: None Jul 22 11:28:26.836815 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Identity-Status: Confirmed Jul 22 11:28:26.836815 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Is-Admin-Project: True Jul 22 11:28:26.836815 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Project-Domain-Id: default Jul 22 11:28:26.836815 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Project-Domain-Name: Default Jul 22 11:28:26.836815 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Project-Id: 04d58bceb8414b02a1bbaec0db07d85e Jul 22 11:28:26.836815 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Project-Name: tempest-TestVolumeBootPattern-945725022 Jul 22 11:28:26.836815 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Role: reader,member Jul 22 11:28:26.836815 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Roles: reader,member Jul 22 11:28:26.838626 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/04d58bceb8414b02a1bbaec0db07d85e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_04d58bceb8414b02a1bbaec0db07d85e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/04d58bceb8414b02a1bbaec0db07d85e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/04d58bceb8414b02a1bbaec0db07d85e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jul 22 11:28:26.838626 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Tenant: tempest-TestVolumeBootPattern-945725022 Jul 22 11:28:26.838626 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Tenant-Id: 04d58bceb8414b02a1bbaec0db07d85e Jul 22 11:28:26.838626 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-Tenant-Name: tempest-TestVolumeBootPattern-945725022 Jul 22 11:28:26.838626 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User: tempest-TestVolumeBootPattern-945725022-project Jul 22 11:28:26.838626 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User-Domain-Id: default Jul 22 11:28:26.838626 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User-Domain-Name: Default Jul 22 11:28:26.838626 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User-Id: 1a299663b56b411b9fc910ddf47103e5 Jul 22 11:28:26.838626 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: X-User-Name: tempest-TestVolumeBootPattern-945725022-project Jul 22 11:28:26.838626 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: method: > Jul 22 11:28:26.838626 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: exception: Instance 36dec2db-4166-4853-a79b-832ad7fc2730 could not be found. Jul 22 11:28:26.838626 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: action_args: {'id': '36dec2db-4166-4853-a79b-832ad7fc2730'} Jul 22 11:28:26.839592 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 22 11:28:26.839592 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:28:26.839592 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 22 11:28:26.839592 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 22 11:28:26.839592 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 22 11:28:26.839592 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 22 11:28:26.839592 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 22 11:28:26.839592 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 22 11:28:26.839592 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 22 11:28:26.839592 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 22 11:28:26.839592 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36dec2db-4166-4853-a79b-832ad7fc2730 could not be found. Jul 22 11:28:26.839592 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:28:26.839592 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:28:26.839592 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:28:26.839592 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:28:26.839592 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:28:26.839592 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:28:26.839592 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 22 11:28:26.839592 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 22 11:28:26.839592 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 22 11:28:26.841193 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 22 11:28:26.841193 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 22 11:28:26.841193 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 22 11:28:26.841193 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 22 11:28:26.841193 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 22 11:28:26.841193 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 22 11:28:26.841193 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 22 11:28:26.841193 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 22 11:28:26.841193 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 22 11:28:26.841193 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36dec2db-4166-4853-a79b-832ad7fc2730 could not be found. Jul 22 11:28:26.841193 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:28:26.841193 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:28:26.841193 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:28:26.841193 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:28:26.841193 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:28:26.841193 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:28:26.841193 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 22 11:28:26.841193 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 22 11:28:26.841193 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36dec2db-4166-4853-a79b-832ad7fc2730 could not be found. Jul 22 11:28:26.841193 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 22 11:28:26.842790 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-16c365e3-4d30-47b9-9565-88e0cb620e8c tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Returning 404 to user: Instance 36dec2db-4166-4853-a79b-832ad7fc2730 could not be found. {{(pid=117885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 22 11:28:26.842790 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-16c365e3-4d30-47b9-9565-88e0cb620e8c tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] 10.222.0.20 "DELETE /compute/v2.1/servers/36dec2db-4166-4853-a79b-832ad7fc2730" status: 404 len: 111 microversion: 2.1 time: 0.032833 Jul 22 11:28:26.842790 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 604/1188] 10.222.0.20 () {58 vars in 1238 bytes} [Fri Jul 22 11:28:26 2022] DELETE /compute/v2.1/servers/36dec2db-4166-4853-a79b-832ad7fc2730 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 22 11:28:26.848313 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-c2926493-d082-45a3-9853-b355d0f7808c tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Calling method '>' {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:28:26.849038 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.compute.api [None req-c2926493-d082-45a3-9853-b355d0f7808c tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] [instance: 36dec2db-4166-4853-a79b-832ad7fc2730] Fetching instance by UUID {{(pid=117884) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 22 11:28:26.854957 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c2926493-d082-45a3-9853-b355d0f7808c tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:28:26.855525 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c2926493-d082-45a3-9853-b355d0f7808c tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:28:26.856305 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c2926493-d082-45a3-9853-b355d0f7808c tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 22 11:28:26.856739 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG oslo_concurrency.lockutils [None req-c2926493-d082-45a3-9853-b355d0f7808c tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Lock "5a7515c3-306c-4208-a5ca-3c2d18d91397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 22 11:28:26.871933 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.wsgi [None req-c2926493-d082-45a3-9853-b355d0f7808c tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] HTTP exception thrown: Instance 36dec2db-4166-4853-a79b-832ad7fc2730 could not be found. Jul 22 11:28:26.873480 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-c2926493-d082-45a3-9853-b355d0f7808c tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Request method failure captured: Jul 22 11:28:26.873480 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: request: GET /compute/v2.1/servers/36dec2db-4166-4853-a79b-832ad7fc2730 HTTP/1.1 Jul 22 11:28:26.873480 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Accept: application/json Jul 22 11:28:26.873480 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Accept-Encoding: identity Jul 22 11:28:26.873480 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Connection: close Jul 22 11:28:26.873480 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Content-Length: 0 Jul 22 11:28:26.873480 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Content-Type: application/json Jul 22 11:28:26.873480 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Host: 10.222.0.20 Jul 22 11:28:26.873480 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Openstack-System-Scope: None Jul 22 11:28:26.873480 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: User-Agent: python-urllib3/1.26.9 Jul 22 11:28:26.873480 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Auth-Token: gAAAAABi2ogmjCFN35PTqtlSgpzQ3l-UABdR039uflNNLPXRj34zwogXxHD0YrMhGDqkpC-lSYaWWXD9Ourj5sd0cDYhOo4wH_3Zbrg-XP_OtyRG6zW9e4tlfhNmHiuhlX2-eN9xtNmSRwHt3dkRVw7OBbkq9qvey7w3mJqVlifrSPb4U_5pqqg Jul 22 11:28:26.873480 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Domain-Id: None Jul 22 11:28:26.873480 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Domain-Name: None Jul 22 11:28:26.873480 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Identity-Status: Confirmed Jul 22 11:28:26.873480 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Is-Admin-Project: True Jul 22 11:28:26.873480 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Domain-Id: default Jul 22 11:28:26.873480 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Domain-Name: Default Jul 22 11:28:26.873480 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Id: 04d58bceb8414b02a1bbaec0db07d85e Jul 22 11:28:26.873480 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Project-Name: tempest-TestVolumeBootPattern-945725022 Jul 22 11:28:26.873480 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Role: reader,member Jul 22 11:28:26.873480 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Roles: reader,member Jul 22 11:28:26.875253 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/04d58bceb8414b02a1bbaec0db07d85e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_04d58bceb8414b02a1bbaec0db07d85e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/04d58bceb8414b02a1bbaec0db07d85e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/04d58bceb8414b02a1bbaec0db07d85e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jul 22 11:28:26.875253 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant: tempest-TestVolumeBootPattern-945725022 Jul 22 11:28:26.875253 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant-Id: 04d58bceb8414b02a1bbaec0db07d85e Jul 22 11:28:26.875253 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-Tenant-Name: tempest-TestVolumeBootPattern-945725022 Jul 22 11:28:26.875253 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User: tempest-TestVolumeBootPattern-945725022-project Jul 22 11:28:26.875253 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Domain-Id: default Jul 22 11:28:26.875253 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Domain-Name: Default Jul 22 11:28:26.875253 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Id: 1a299663b56b411b9fc910ddf47103e5 Jul 22 11:28:26.875253 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: X-User-Name: tempest-TestVolumeBootPattern-945725022-project Jul 22 11:28:26.875253 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: method: > Jul 22 11:28:26.875253 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: exception: Instance 36dec2db-4166-4853-a79b-832ad7fc2730 could not be found. Jul 22 11:28:26.875253 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: action_args: {'id': '36dec2db-4166-4853-a79b-832ad7fc2730'} Jul 22 11:28:26.876254 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: {{(pid=117884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 22 11:28:26.876254 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:28:26.876254 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 22 11:28:26.876254 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 22 11:28:26.876254 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 22 11:28:26.876254 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 22 11:28:26.876254 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 22 11:28:26.876254 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 22 11:28:26.876254 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 22 11:28:26.876254 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 22 11:28:26.876254 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36dec2db-4166-4853-a79b-832ad7fc2730 could not be found. Jul 22 11:28:26.876254 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:28:26.876254 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:28:26.876254 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:28:26.876254 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:28:26.876254 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:28:26.876254 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:28:26.876254 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 22 11:28:26.876254 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 22 11:28:26.876254 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 22 11:28:26.877808 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 22 11:28:26.877808 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 22 11:28:26.877808 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 22 11:28:26.877808 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 22 11:28:26.877808 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 22 11:28:26.877808 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 22 11:28:26.877808 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 22 11:28:26.877808 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36dec2db-4166-4853-a79b-832ad7fc2730 could not be found. Jul 22 11:28:26.877808 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:28:26.877808 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 22 11:28:26.877808 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:28:26.877808 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 22 11:28:26.877808 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 22 11:28:26.877808 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 22 11:28:26.877808 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 22 11:28:26.877808 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 22 11:28:26.877808 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36dec2db-4166-4853-a79b-832ad7fc2730 could not be found. Jul 22 11:28:26.877808 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: ERROR nova.api.openstack.wsgi Jul 22 11:28:26.880163 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: DEBUG nova.api.openstack.wsgi [None req-c2926493-d082-45a3-9853-b355d0f7808c tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Returning 404 to user: Instance 36dec2db-4166-4853-a79b-832ad7fc2730 could not be found. {{(pid=117884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 22 11:28:26.880163 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO nova.api.openstack.requestlog [None req-c2926493-d082-45a3-9853-b355d0f7808c tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] 10.222.0.20 "GET /compute/v2.1/servers/36dec2db-4166-4853-a79b-832ad7fc2730" status: 404 len: 111 microversion: 2.1 time: 0.031143 Jul 22 11:28:26.880163 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: [pid: 117884|app: 0|req: 585/1189] 10.222.0.20 () {58 vars in 1235 bytes} [Fri Jul 22 11:28:26 2022] GET /compute/v2.1/servers/36dec2db-4166-4853-a79b-832ad7fc2730 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 22 11:28:28.264285 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-1f34358a-b97e-474a-a997-534244d78837 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] Calling method '.version_select at 0x7f844985f940>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 11:28:28.284675 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-1f34358a-b97e-474a-a997-534244d78837 tempest-TestVolumeBootPattern-945725022 tempest-TestVolumeBootPattern-945725022-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-600883544" status: 202 len: 0 microversion: 2.1 time: 0.024015 Jul 22 11:28:28.286110 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 605/1190] 10.222.0.20 () {58 vars in 1259 bytes} [Fri Jul 22 11:28:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-600883544 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 22 11:29:05.487551 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 22 11:29:05.488245 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Fri Jul 22 11:29:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 22 11:29:14.132498 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 22 11:29:14.133182 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Fri Jul 22 11:29:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 22 11:29:55.182082 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 22 11:29:55.182817 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Fri Jul 22 11:29:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 22 11:30:42.658834 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 22 11:30:42.659673 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Fri Jul 22 11:30:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 22 11:31:05.659121 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 22 11:31:05.660041 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Fri Jul 22 11:31:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 22 11:32:25.496371 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 22 11:32:25.497262 dv-cinder-848900-4-iscsi devstack@n-api.service[117885]: Fri Jul 22 11:32:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 22 11:32:34.142301 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 22 11:32:34.142931 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Fri Jul 22 11:32:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 22 11:33:15.191735 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 22 11:33:15.192493 dv-cinder-848900-4-iscsi devstack@n-api.service[117884]: Fri Jul 22 11:33:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!